phi-3-mediumをllamafileで動かしてみた

<|user|>\nQuestion <|end|>\n<|assistant|>

.\llamafile-0.8.6.exe -m .\Phi-3-medium-128k-instruct-Q4_K_M.gguf -p "<|user|>what is best movies?<|end|><|assistant|>"

 \n what is best movies? \n Determining the "best" movies can be quite subjective as it depends on personal taste, genre preferences, and cultural background. However, there are several lists that can give you an idea of what are considered to be the best movies by critics and audiences alike.

1. **The IMDb Top 250**: IMDb's list of the top-rated movies is based on votes from over 3 million members. The list is updated weekly.

2. **The American Film Institute's 100 Years... 100 Movies**: This is a list of the top 100 films in American cinema as chosen by a jury of over 1,500 people from the film industry.

3. **The Sight & Sound Top 100**: This list is voted on by an international group of film critics and is updated every ten years.

4. **The Criterion Collection**: Although not a list of the "best" movies per se, the Criterion Collection is a series of DVDs and Blu-rays that aims to be the definitive edition of important classic and contemporary films, with an emphasis on artistic merit.

5. **Rotten Tomatoes**: While Rotten Tomatoes doesn't have a "best" list per se, it does have a "Top 250" list that includes movies with the best critics' scores.

6. **Metacritic**: Similar to Rotten Tomatoes, Metacritic provides a comprehensive list of movies rated by critics, with scores and reviews.

7. **The National Society of Film Critics Awards**: This organization gives out awards for the best films of the year, and they have a list of past winners.

Remember, the "best" movies for you might not be on any of these lists. The beauty of film is that there's something out there for everyone, no matter what your tastes might be. [end of text]

llama_print_timings:        load time =    5718.29 ms
llama_print_timings:      sample time =      16.69 ms /   441 runs   (    0.04 ms per token, 26423.01 tokens per second)
llama_print_timings: prompt eval time =    1485.92 ms /    13 tokens (  114.30 ms per token,     8.75 tokens per second)
llama_print_timings:        eval time =  116930.40 ms /   440 runs   (  265.75 ms per token,     3.76 tokens per second)
llama_print_timings:       total time =  118582.46 ms /   453 tokens

.\llamafile-0.8.6.exe -m .\Phi-3-medium-128k-instruct-Q4_K_M.gguf -p "<|user|>\n what is best movies?<|end|>\n<|assistant|>" -ngl 9999

llama_print_timings:        load time =    9281.69 ms
llama_print_timings:      sample time =      37.85 ms /   820 runs   (    0.05 ms per token, 21662.18 tokens per second)
llama_print_timings: prompt eval time =     986.36 ms /    13 tokens (   75.87 ms per token,    13.18 tokens per second)
llama_print_timings:        eval time =  730383.23 ms /   819 runs   (  891.80 ms per token,     1.12 tokens per second)
llama_print_timings:       total time =  731852.95 ms /   832 tokens

.\llamafile-0.8.6.exe -m .\Phi-3-medium-128k-instruct-Q4_K_M.gguf --server

<|user|>
日本で一番有名な人は誰ですか？<|end|>
<|assistant|>「最も有名」という言葉によって、さまざまな分野での知名度や影響力を基準にした判断が必要となります。一般的には多くの場合次の人物が候補となることがあります：

- 政治家:安倍晋三（元首相）

- 文学者・作家:村上春樹

- アニメーションクリエイター:宮崎駿

これらの人物は日本国内だけでなく、世界的にも高い知名度を持っております。<|end|>