Torch inferencer#2

Open

Gabriel-Munoz wants to merge 7 commits into

torch_inferencer

Commits on Feb 17, 2025

try to add torch inferencer
zrzz-hq
committed

Commits on Mar 6, 2025

made pytorch inferencer
zrzz-hq
committed

Commits on Mar 27, 2025

Commits on Mar 28, 2025

made the code parse the Json in load model so it only does it once, improving latency
Gabriel-Munoz
committed

Commits on Apr 2, 2025

abstract base class made
Gabriel-Munoz
committed

Commits on Apr 10, 2025

final changes for cpp conversion for pt inferencer
Gabriel-Munoz
committed