Nous Research +1 · released 2024-06-20
Hermes 2 Theta Llama-3 70B uses about 0.079 Wh of electricity to answer a typical question. A long, complex answer costs about 23× more, at 1.84 Wh. That places it 151 of 277 among the models we can measure, and every figure here is calculated the same way as every other model.
Calculated Calculated from a published parameter count. Every model on this site is calculated the same way, so the comparison holds even where the absolute value carries uncertainty. Our figures are good to roughly a factor of two to three, which is why we only ever state a difference of 5× or more.
Energy cannot be worked out without knowing how big a model is. Of the 1 models from Nous Research +1 that we track, 1 can be assessed at all, the rest publish too little for anyone outside the company to calculate anything.
Capability and the roster come from Epoch AI, whose Capabilities Index is the 58-benchmark composite quoted above. Energy is calculated with EcoLogits and calibrated against laboratory measurements from ML.ENERGY. Human preference comes from LMArena. All four are public and free; the full method is here.
These figures are published under CC BY 4.0, use them anywhere, including commercially, with credit to The AI Footprint.
Compare Hermes 2 Theta Llama-3 70B with another model
Or work out what a year of using it adds up to, for you or for a whole organisation.