Is photo calorie counting accurate?

Updated on

Not to the gram. Studies that compared AI photo estimates with weighed meals found large average errors, mostly underestimates. A photo gives a useful estimate when you know how far to trust it. FotoMeal shows, on every scan, how sure the AI says it is, so you know when to check.

What the studies measured

Three recent studies are the most useful here, because they compared estimates with meals that were actually weighed.

The second study tested GPT-4o, the model FotoMeal uses for the photo scan: its figures apply to us too. Each study has its limits (number of meals, type of dishes, how the photos were taken), listed in the sources at the bottom of the page. We review this section every quarter.

Why a photo fools an AI

What FotoMeal does with this margin of error

How to read the confidence score

The score is the certainty the AI declares about its own estimate, from 0 to 100%. FotoMeal reads it as given, keeps it between 0 and 100%, and sets it to 0 when the photo is refused. Nobody has yet checked that a low score really goes with a larger error: that is exactly what our weighed test is for (below). Until then, read it as a signal to check, not as a measured accuracy.

Getting a better estimate

When an estimate is not enough

FotoMeal gives estimates, not medical advice. If you follow a medical diet, live with diabetes or a metabolic condition, are pregnant, or have a difficult relationship with food, talk to a doctor or a dietitian before relying on calorie counting. See our terms of use.

Our test: 50 weighed meals, protocol published first

We will weigh 50 real meals and compare them with FotoMeal's estimates. We publish the protocol before the test, so that we cannot adjust it to the results.

  1. 50 everyday meals, home-cooked and from restaurants or takeaways, chosen in advance by type (simple dishes, mixed dishes, dishes with sauce, snacks).
  2. Each meal is photographed with FotoMeal on the same phone, from above, in normal light. We record the estimate (calories, macros) and the confidence score as they come, with no correction.
  3. Each ingredient is then weighed on a kitchen scale, and the reference values are calculated from the packaging or from a public nutrition table.
  4. For each meal: the gap between the estimate and the reference, in calories and in percent.
  5. Results grouped by colour (green, orange, red). The hypothesis we test: the gap is larger when the score is lower. If it is not, we will say so.
  6. No meal is removed after the fact. Photos refused by the app are counted separately.

Limits we state up front: one person, one phone, 50 meals; it is a test, not a peer-reviewed study. The full results, meal by meal, will be published on this page.

Questions

Can an app count calories from a photo to the gram?

No. A photo shows neither the oil, nor the hidden ingredients, nor the exact weight. Recent studies measure large average errors. A photo gives an estimate you check and adjust.

Is FotoMeal more accurate than other photo apps?

We do not claim so. FotoMeal uses GPT-4o, the model one of these studies tested, and shows on every scan how sure the AI says it is, so you know when to check.

What does the confidence score mean?

It is the certainty the AI declares about its own estimate, from 0 to 100%. It is not a measured accuracy. Under 60%, FotoMeal warns you and opens the values for editing.

When should I weigh instead?

When precision matters: a medical diet, diabetes, a sports goal with tight margins, or any meal the app flags as uncertain. For packaged food, the barcode is more reliable than a photo.

Will you publish the weighed test results even if they are bad?

Yes. The protocol is on this page before the test starts, and the results will be published as they are, with every meal.

Sources

Try FotoMeal

Barcode, search, manual entry and journal are free for life. The photo scan comes with a 7-day free trial, then €29.99 a year in the euro area (your store shows the price in your currency).