2024/4/26

text-generation-webui run microsoft_Phi-3-mini-128k-instruct error : trust_remote_code=True

load 玩model出現錯誤,console 顯示
ValueError: Loading models/microsoft_Phi-3-mini-128k-instruct requires you to execute the configuration file in that repo on your local machine. 
Make sure you have read the code there to avoid malicious use, then set the option `trust_remote_code=True` to remove this error.
在model tab 有一個checkbox 剛好就是 trust_remote_code,上面的說明:
Set trust_remote_code=True while loading the tokenizer/model. To enable this option, start the web UI with the --trust-remote-code flag.
所以是在啟動的時候...
./start_linux.sh --listen --trust-remote-code
哪個checckout 就check 了,model load and run OK

沒有留言:

張貼留言