Skip to content

LLM output regression from #857 building with Emscripten #885

@brendandahl

Description

@brendandahl

After #857, I now get gibberish from the llm output when using emscripten to build gemma.cpp.

To build you'll need emsdk and apply my patches from #833.

emcmake cmake -DCMAKE_POLICY_VERSION_MINIMUM=3.5 -B build-wasm
make -j -C build-wasm
node build-wasm/gemma.js --weights 270m-sfp-it.sbs --max_generated_tokens 100 --prompt "Why is the sky blue?"

Previous output: Something about rayleigh scattering...
New output: áis собой Росії3atayavisフレックスateur choice...

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions