Skip to content

0.0.21

Choose a tag to compare

@PlanteAmigor PlanteAmigor released this 07 Jun 15:49

管道模式(--mode pipe

四个命令新增 --mode pipe 管道模式:

命令 管道输入 stdout 输出
asr 音频文件路径 {"text":"...","time":n}
tts 合成文本 {"path":"...","text":"...","time":n}
chat 提示词 {"text":"...","time":n}
image 描述 {"path":"...","time":n}

模型常驻内存,每次推理 0.5~10s,无需重载。外部程序通过 stdin/stdout 即可高效调用。


Pipe Mode (--mode pipe)

Four commands now support --mode pipe (pipeline mode):

Command Pipe Input stdout Output
asr audio file path {"text":"...","time":n}
tts text to synthesize {"path":"...","text":"...","time":n}
chat prompt {"text":"...","time":n}
image description {"path":"...","time":n}

Model stays in memory, each inference takes 0.5~10s without reloading. External programs can efficiently call via stdin/stdout.