FmhaFwdLogitsSoftCapKargs Struct Reference

• ck_tile
• FmhaBatchPrefillWithPagedKVCacheKernel
• FmhaFwdLogitsSoftCapKargs

Public Member Functions | Public Attributes | List of all members

ck_tile::FmhaBatchPrefillWithPagedKVCacheKernel< FmhaPipeline_, EpiloguePipeline_ >::FmhaFwdLogitsSoftCapKargs Struct Reference

#include <fmha_batch_prefill_kernel.hpp>

Public Member Functions
	FmhaFwdLogitsSoftCapKargs ()=default
void	init_logits_soft_cap (float logits_soft_cap_)

Public Attributes
float	logits_soft_cap
float	logits_soft_cap_rcp

Constructor & Destructor Documentation

◆ FmhaFwdLogitsSoftCapKargs()

template<typename FmhaPipeline_, typename EpiloguePipeline_>

ck_tile::FmhaBatchPrefillWithPagedKVCacheKernel< FmhaPipeline_, EpiloguePipeline_ >::FmhaFwdLogitsSoftCapKargs::FmhaFwdLogitsSoftCapKargs ( )

default

Member Function Documentation

◆ init_logits_soft_cap()

template<typename FmhaPipeline_, typename EpiloguePipeline_>

void ck_tile::FmhaBatchPrefillWithPagedKVCacheKernel< FmhaPipeline_, EpiloguePipeline_ >::FmhaFwdLogitsSoftCapKargs::init_logits_soft_cap ( float logits_soft_cap_ )

inline

Member Data Documentation

◆ logits_soft_cap

template<typename FmhaPipeline_, typename EpiloguePipeline_>

float ck_tile::FmhaBatchPrefillWithPagedKVCacheKernel< FmhaPipeline_, EpiloguePipeline_ >::FmhaFwdLogitsSoftCapKargs::logits_soft_cap

◆ logits_soft_cap_rcp

template<typename FmhaPipeline_, typename EpiloguePipeline_>

float ck_tile::FmhaBatchPrefillWithPagedKVCacheKernel< FmhaPipeline_, EpiloguePipeline_ >::FmhaFwdLogitsSoftCapKargs::logits_soft_cap_rcp

---

The documentation for this struct was generated from the following file:

• fmha_batch_prefill_kernel.hpp