Skip to content

Unable to run Janus Pro locally using Chrome on Ubuntu 22.04 LTS #34

Open
@amalic

Description

@amalic

I am getting this error message when I load the model on my Workstation

  • 16 Core / 32 Threads AMD Epyc CPU
  • 64 GB Ram
  • 1080 Ti
  • Ubuntu 22.04 LTS
  • Chrome 132.0.6834.159 (Official Build) (64-bit)

First I had issues enabling Vulkan and WebGPU which i eventually managed.

When loading the model I got this error message

u/huggingface_transformers.js?v=82803131:12815 Uncaught (in promise) Error: Can't create a session. failed to allocate a buffer of size 2079237968.
at Kt (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:12815:30)
at Cr (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:12820:123)
at pc (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13085:25)
at pn.loadModel (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13156:165)
at mn.createInferenceSessionHandler (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13205:28)
at e.create (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:4338:51)
at async createInferenceSession (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13354:25)
at async http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:18985:29
at async Promise.all (index 0)
at async constructSessions (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:18982:35)

After running it with this switch to increas max Ram using this command google-chrome --args --js-flags="--max_old_space_size=8192" I am getting this error message on the console.

Uncaught (in promise) 4168718248

I don't know what this means.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions