FoodRush is designed as a two player interactive arcade game that allows people to compete the right utensil to eat food. This game was exhibited in Wonderville, Brooklyn, New York on December 5 and 6, 2019.
FoodRush is designed as a two player interactive arcade game that allows people to compete the right utensil to eat food. This game was exhibited in Wonderville, Brooklyn, New York on December 5 and 6, 2019.
FoodRush is designed as a two player interactive arcade game that allows people to compete the right utensil to eat food. This game was exhibited in Wonderville, Brooklyn, New York on December 5 and 6, 2019.
ZHUYUAN HE
NutriMonster
MIT Reality Hack 2020
Role: interaction design, storytelling, UX, 3D Modeling and Animation, logo, video
Reality Hack is by far the biggest XR hackathon event around the world. In 2020, there are around 300 hackers from different countries formed over 60 teams in this event. In 4 days, we built NutriMonster: An omnichannel experience for health-conscious grocery shoppers enabled by AR glasses like Magic Leap or Nreal.
Our working prototype is the winner of Best Use of Vuforia (AR, Sponsored by PTC)
Persona & Storyboard
 |  |  |
|---|---|---|
 |  |
Problem
Physical products can only display a limited amount of information, and companies chose to display what sells - not what you need to know.
​
Solution
NutriMonsters overlays physical products with an AR-filter to only display the information you really need to know, stripping away any manipulative influence of brands or claims.
​
Displayed information
We used the logos of the NutriScore, a food labelling system already used throughout Europe (France, Spain, UK, Belgium, Switzerland, Germany). The NutriScore is a summary of the nutritional quality of foods. Its disadvantage is: consumers don't understand why a product gets a good or a bad rating. By choosing how much information to display at which distance, NutriMonsters helps consumers to quickly browse but also to see more detailed information when needed.
​
In the meanwhile, we brought animated characters into our design to represent the four major nutrition related element: sugar, saturated fat, sodium and calories. By giving personalities and characteristics to the elements, we want to draw the attention of users from brand to our application and help the users to build a connection between users and the characters rather than be influenced by the brands. ​​​​​​​​​​​​​
Tech Stack
The MVP is an app for Android and MagicLeap: the app detects images through Vuforia and pulls nutritional information through a Rest API from OpenFoodFacts, the largest open-source food database with over 1 Million food products.​
Why AR?
We see image recognition as an addition to barcode reading, not a replacement; The advantage of image recognition is when comparing two products at the same time; it is more intuitive and allows to recognize a product from further away than barcodes. We built this prototype with upcoming wearable glasses in our mind.​VerticalsThis technology is also applicable for diabetics (Glycemic Index combined with current blood sugar tells you when a food is ok to eat, when not), people with intolerances or people concerned about unethical or unsustainable products, especially in cosmetics.​
Vision
We believe that primary packaging may be redundant in a world of deliveries. This AR shopping experience is an omnichannel experience that combines the advantages of the online world (variety) with the offline world (discovery) and sets us up for ghost supermarkets, where products wouldn't be in the store anymore but are displayed on displays.​
Built With
-
Andorid
-
Openfoodfacts
-
API
-
Blender
-
machine-learning
-
Magic Leap
-
mobile
-
Nutriscore
-
Unity
-
Visual-studio
-
Vuforia
-
Figma
-
photoshop