
Making a non-scientific benchmark with Python and Llama-CPP

About per week before the time of writing this story, latest open Llama-3 models were released by Meta. As claimed by Meta, these are “the most effective models existing today on the 8B and 70B parameter scales.” For instance, based on a HuggingFace model page, Llama-3 8B got a…