Running the model using HF backend
#20
by sahilj2701 - opened
Hi,
I am trying to run the model on niah_multikey_2, niah_multikey_3, but the output is always wrong. I am using the transformers latest version. Has anybody tried this? Is there any issue with the HF backend in particular? All other non-hybrid models work fine.
Any help is appreciated!