CUDNN Frontend API
8.3.0
|
Plan Cache structure for the above table. More...
#include <cudnn_frontend_ExecutionPlanCache.h>
Classes | |
struct | compare |
Public Member Functions | |
virtual bool | is_fastest_plan_stable (const cudnn_frontend::OperationGraph &op_graph, const std::string &tag) |
void | add_plan_to_cache (const cudnn_frontend::OperationGraph &op_graph, const cudnn_frontend::ExecutionPlan &plan) |
ExecutionPlanCache_v1 (const char *name_) | |
const std::string & | get_name () const |
bool | get_plan_from_cache (const cudnn_frontend::OperationGraph &op_graph, const cudnn_frontend::ExecutionPlan *&plan) const |
Protected Types | |
using | FeatureVectorToPlanMap = std::map< cudnn_frontend::feature_vector_t, cudnn_frontend::ExecutionPlan, cudnn_frontend::ExecutionPlanCache_v1::compare > |
Protected Attributes | |
std::string | name = "plan_cache_[unnamed]" |
FeatureVectorToPlanMap | cache |
std::mutex | cache_mutex |
Plan Cache structure for the above table.
Definition at line 79 of file cudnn_frontend_ExecutionPlanCache.h.
String to map of feature_vector to execution plan For a given FeatureVector of type T according to the Operation Graph, we get the plan.
Definition at line 96 of file cudnn_frontend_ExecutionPlanCache.h.
|
inline |
Definition at line 115 of file cudnn_frontend_ExecutionPlanCache.h.
|
inline |
Definition at line 108 of file cudnn_frontend_ExecutionPlanCache.h.
References cudnn_frontend::OperationGraph_v8::getFeatureVector(), cudnn_frontend::getLogger(), and cudnn_frontend::OperationGraph_v8::getTag().
|
inline |
Definition at line 119 of file cudnn_frontend_ExecutionPlanCache.h.
References name.
|
inline |
Definition at line 124 of file cudnn_frontend_ExecutionPlanCache.h.
References cudnn_frontend::OperationGraph_v8::getFeatureVector(), and cudnn_frontend::getLogger().
Referenced by cudnn_frontend::ExecutionPlanCache_v2::is_fastest_plan_stable().
|
inlinevirtual |
Reimplemented in cudnn_frontend::ExecutionPlanCache_v2.
Definition at line 103 of file cudnn_frontend_ExecutionPlanCache.h.
|
protected |
Definition at line 97 of file cudnn_frontend_ExecutionPlanCache.h.
|
mutableprotected |
Definition at line 99 of file cudnn_frontend_ExecutionPlanCache.h.
Referenced by cudnn_frontend::ExecutionPlanCache_v2::is_fastest_plan_stable().
|
protected |
Definition at line 92 of file cudnn_frontend_ExecutionPlanCache.h.
Referenced by get_name(), and cudnn_frontend::ExecutionPlanCache_v2::is_fastest_plan_stable().