Input path: /home/debian/html/nutritwin/output_llm/663a530e47a57/input.json Output path: /home/debian/html/nutritwin/output_llm/663a530e47a57/output.json Input text: I just ran a mile and ate a pizza DB path: __deriveddata__/DerivedObjects/Data/KcalMeDB_fr.sl3 Picto path: __deriveddata__/DerivedObjects/Data/PictoMatcherNetNG_fr.json Sport grounding path: __deriveddata__/DerivedObjects/Data/DerivedSportMET.json ================================================================================================================================== Prompt from user: I just ran a mile and ate a pizza ================================================================================================================================== ==================================== Prompt ============================================= Identify in this list of intents: ["Identify food consumption or declaration", "Identify the user physical activity", "Answer a nutrition question", "Other intent"], the intents of the prompt: ###I just ran a mile and ate a pizza###. Format the result in JSON format: {intents: []}. ========================================================================================= ------------------------------ LLM Raw response ----------------------------- ```json { "intents": ["Identify food consumption or declaration", "Identify the user physical activity"] } ``` ----------------------------------------------------------------------------- ----------------- Make it compliant ------------------ ```json { "intents": ["Identify food consumption or declaration", "Identify the user physical activity"] } ``` ------------------------------------------------------ ------------------------ After simplification ------------------------ { "intents": ["Identify food consumption or declaration", "Identify the user physical activity"]} ---------------------------------------------------------------------- ==================================== Prompt ============================================= Convert this natural language query : """I just ran a mile and ate a pizza""" into an array in JSON of consumed foods and beverages. Provide a solution without explanation. Use only the ontology described in this RDF model: """ @prefix food: . @prefix rdfs: . @prefix xsd: . @prefix owl: . @prefix prov: . food: a owl:Ontology ; rdfs:comment "Definition of the food archetype"@en . food:name a owl:DatatypeProperty; rdfs:label "name"@en; rdfs:comment "Food or drink identifier, the name should not contain information related to quantity or container (like glass...). The cooking mode is not in the name. Keep the same language"@en; rdfs:range xsd:string. food:quantity a owl:DatatypeProperty ; rdfs:label "quantity"@en; rdfs:comment "The quantity of food or drink that is or was consumed. Quantity examples in french: 'un quignon', 'un cornet', 'un verre', 'une tranche', 'une boule', 'un', 'deux', 'trois',... Keep the same language."@en; rdfs:range xsd:string. food:cookingMethod a owl:DatatypeProperty ; rdfs:label "cooking method"@en; rdfs:comment "The cooking method of food. Keep the same language"@en; rdfs:range xsd:string. food:type a owl:DatatypeProperty ; rdfs:label "type of food"@en; rdfs:comment "Identify the type of food."@en; rdfs:range xsd:string. food:food a food:type ; rdfs:label "food" . food:beverage a food:type ; rdfs:label "beverage" . food:timeOfTheDay a owl:DatatypeProperty ; rdfs:label "time of the day"@en; rdfs:comment "Time of the day when food or drink was consumed."@en; rdfs:range xsd:string. food:breakfast a food:timeOfTheDay ; rdfs:label "breakfast" . food:lunch a food:timeOfTheDay ; rdfs:label "lunch" . food:snacking a food:timeOfTheDay ; rdfs:label "snacking" . food:dinner a food:timeOfTheDay ; rdfs:label "dinner" . food:brand a owl:DatatypeProperty ; rdfs:label "Brand"@en; rdfs:comment "Food or beverage brand. The restaurants are not brand. When the 'brand' is not specified and, the food or beverage is very well-known (like 'Coca-Cola'), provide the brand name in 'brand', otherwise set 'brand' to ''."@en; rdfs:range xsd:string. food:company a owl:DatatypeProperty ; rdfs:label "Company"@en; rdfs:comment "Product company."@en; rdfs:range xsd:string. food:event a owl:DatatypeProperty ; rdfs:label "event"@en; rdfs:comment "Event of eating or drinking. Each must have an event"@en; rdfs:range xsd:string. food:intent a food:event ; rdfs:label "intent" . rdfs:comment "When the event should happen"@en. food:declaration a food:event ; rdfs:label "declaration" . rdfs:comment "When the event has already occured"@en. food:unknownEvent a food:event ; rdfs:label "unknown" ; rdfs:comment "When the event is unknown in the day"@en. """ ========================================================================================= ------------------------------ LLM Raw response ----------------------------- ```json [ { "food:name": "pizza", "food:quantity": "one", "food:cookingMethod": "", "food:type": "food", "food:timeOfTheDay": "", "food:brand": "", "food:company": "", "food:event": "declaration" } ] ``` ----------------------------------------------------------------------------- ----------------- Make it compliant ------------------ ```json [ { "food:name": "pizza", "food:quantity": "one", "food:cookingMethod": "", "food:type": "food", "food:timeOfTheDay": "", "food:brand": "", "food:company": "", "food:event": "declaration" } ] ``` ------------------------------------------------------ ------------------------ After simplification ------------------------ [ { "food:name": "pizza", "food:quantity": "one", "food:cookingMethod": "", "food:type": "food", "food:timeOfTheDay": "", "food:brand": "", "food:company": "", "food:event": "declaration" }] ---------------------------------------------------------------------- --------------------------------- LLM result ----------------------------------- {'response': [{'food:name': 'pizza', 'food:quantity': 'one', 'food:cookingMethod': '', 'food:type': 'food', 'food:timeOfTheDay': '', 'food:brand': '', 'food:company': '', 'food:event': 'declaration'}], 'cost': 0.0} -------------------------------------------------------------------------------- ----------- result to be analyzed ----------- {'name': 'pizza', 'quantity': 'one', 'cookingMethod': '', 'type': 'food', 'timeOfTheDay': '', 'brand': '', 'company': '', 'event': 'declaration'} First try: SELECT V_Name,V_Comment,V_NormName,V_NormComment,V_PackType,V_GTIN,V_GTINRef,V_ID,V_GlobalCount,V_NormTrademark,V_Trademark,V_NormAggr FROM KCALME_TABLE WHERE V_NormName LIKE '% pizza %' AND (V_NormTrademark = '' OR V_NormTrademark IS NULL) ------------- Found solution (max 20) -------------- Pizza - pizza - - - 10599 - - - CIQ#733e507c20c6036da06902e2929056db Pizza - pizza - - - 0 - - - KCA#733e507c20c6036da06902e2929056db Pizza - pizza - sauce garniture pour - - 0 - - - CIQ#a275181c086396e0bec873fcc94008cb Pizza Kebab - pizza kebab - - - 6 - - - CIQ#6bbe41be8630f033bfe294b94bbf8d0c Pizza Moyenne - pizza moyenne - - - 38 - - - KCA#9bdfcad1de65c2ebcc7384d0aa3fa55f Pizza au Thon - pizza thon - - - 16 - - - CIQ#5f444b59309014aeab27095b6eb2d95b Pizza Fromage - pizza fromage - - - 0 - - - KCA#5175d910a3bb5ffe553ada3ee1d50309 Pizza au Poulet - pizza poulet - - - 0 - - - CIQ#33e0a5ea4366eeb0aad919629cf8f008 Pizza au Saumon - pizza saumon - - - 0 - - - CIQ#531c0deee226a1ed25c6ad7e9344ecef Pizza 4 Fromages - pizza fromage - - - 2361 - - - CIQ#5175d910a3bb5ffe553ada3ee1d50309 Pizza 'Spéciale' - pizza speciale - - - 146 - - - KCA#a6f6dd5434366be39fec21c560e1457e Pizza à la Poêle - pizza poele - - - 64 - - - KCA#2cd730363965f0d5363b216aaaa75f26 Pizza Boulangerie - pizza boulangerie - - - 318 - - - KCA#291611656924ce924ca7d5200705c55e Pizza à la Viande - pizza viande - type bolognaise - - 0 - - - CIQ#b17f77e6924678e84c353cde4ec8bdc4 Pizza aux Lardons - pizza au lardon - oignons et fromage - - 0 - - - CIQ#2ff2fb0af20f513208206f7883b4b537 Pizzas Végétariennes - pizza vegetarienne - - - 566 - - - KCA#9f884aabd1a0211b685859e3d93bb8c8 Pizza Jambon Fromage - pizza jambon fromage - - - 405 - - - CIQ#a5c5fe6f659b72fa37b3770428f770e9 Pizza Jambon Fromage - pizza jambon fromage - - - 0 - - - KCA#a5c5fe6f659b72fa37b3770428f770e9 Pizza Tomate et Fromage - pizza tomate fromage - - - 111 - - - KCA#0962f5517452bf8b32ecb09f5f3166da Pizza aux Fruits de Mer - pizza au fruit de mer - - - 0 - - - CIQ#d9baa96a97f96e931fba42a44879122e ---------------------------------------------------- ERROR: no solution for picto in the first solution ERROR: no solution for picto in the first solution ERROR: no solution for picto in the first solution ==================================== Prompt ============================================= Convert this natural language query : """I just ran a mile and ate a pizza""" into an array in JSON of sport or physical activities. Provide a solution without explanation. Use only the ontology described in this RDF model: """ @prefix activity: . @prefix rdfs: . @prefix xsd: . @prefix owl: . @prefix prov: . activity: a owl:Ontology ; rdfs:comment "Definition of the sport and physical activity archetype"@en . activity:name a owl:DatatypeProperty; rdfs:label "name"@en; rdfs:comment "Sport or physical activity identifier, the name should not contain information related to duration. Ignore the negative action. Keep the same language"@en; rdfs:range xsd:string. # Define the enumeration class activity:EnumActivity a rdfs:Class . activity:BasketBall a activity:EnumActivity ; rdfs:label "Basket-ball is the exact name" . activity:Cyclisme a activity:EnumActivity ; rdfs:label "Cyclisme is the exact name" . activity:Boxe a activity:EnumActivity ; rdfs:label "Boxe is the exact name" . activity:Danse a activity:EnumActivity ; rdfs:label "Danse is the exact name" . activity:Zumba a activity:EnumActivity ; rdfs:label "Zumba is the exact name" . activity:PlongeeSousMarine a activity:EnumActivity ; rdfs:label "Plongée sous-marine is the exact name" . activity:Escrime a activity:EnumActivity ; rdfs:label "Escrime is the exact name" . activity:Football a activity:EnumActivity ; rdfs:label "Football is the exact name" . activity:Jardinage a activity:EnumActivity ; rdfs:label "Jardinage is the exact name" . activity:Golf a activity:EnumActivity ; rdfs:label "Golf is the exact name" . activity:Gymnastique a activity:EnumActivity ; rdfs:label "Gymnastique is the exact name" . activity:Judo a activity:EnumActivity ; rdfs:label "Judo is the exact name" . activity:Karate a activity:EnumActivity ; rdfs:label "Karaté is the exact name" . activity:CordeASauter a activity:EnumActivity ; rdfs:label "Corde à sauter is the exact name" . activity:RameurDAppartement a activity:EnumActivity ; rdfs:label "Rameur d'appartement is the exact name" . activity:CourseAPied a activity:EnumActivity ; rdfs:label "Course à pied is the exact name" . activity:FaireLAmour a activity:EnumActivity ; rdfs:label "Faire l'amour is the exact name" . activity:SkiDeDescente a activity:EnumActivity ; rdfs:label "Ski de descente is the exact name" . activity:Natation a activity:EnumActivity ; rdfs:label "Natation is the exact name" . activity:Tennis a activity:EnumActivity ; rdfs:label "Tennis is the exact name" . activity:TapisDeCourse a activity:EnumActivity ; rdfs:label "Tapis de course is the exact name" . activity:SkiDeFond a activity:EnumActivity ; rdfs:label "Ski de fond is the exact name" . activity:VeloDAppartement a activity:EnumActivity ; rdfs:label "Vélo d'appartement is the exact name" . activity:Aquabiking a activity:EnumActivity ; rdfs:label "Aquabiking is the exact name" . activity:VeloElliptique a activity:EnumActivity ; rdfs:label "Vélo elliptique is the exact name" . activity:Equitation a activity:EnumActivity ; rdfs:label "Equitation is the exact name" . activity:Escalade a activity:EnumActivity ; rdfs:label "Escalade is the exact name" . activity:PatinsEnLigne a activity:EnumActivity ; rdfs:label "Patins en ligne is the exact name" . activity:TennisDeTable a activity:EnumActivity ; rdfs:label "Tennis de table is the exact name" . activity:Marche a activity:EnumActivity ; rdfs:label "Marche is the exact name" . activity:MarcheAvecUnChien a activity:EnumActivity ; rdfs:label "Marche avec un chien is the exact name" . activity:TachesMenageres a activity:EnumActivity ; rdfs:label "Tâches ménagères is the exact name" . activity:MarcheNordique a activity:EnumActivity ; rdfs:label "Marche nordique is the exact name" . activity:duration a owl:DatatypeProperty ; rdfs:label "duration"@en; rdfs:comment "The duration must be a number and must be in minute. If the duration is unknown, set duration to 0. A full day of activity is equivalent to a duration of 8 hours. A half day of activity is equivalent to a duration of 4 hours."@en; rdfs:range xsd:integer. activity:event a owl:DatatypeProperty ; rdfs:label "event"@en; rdfs:comment "Event of eating or drinking. Each must have an event"@en; rdfs:range xsd:string. activity:intent a activity:event ; rdfs:label "intent" ; rdfs:comment "When the event should happen"@en. activity:declaration a activity:event ; rdfs:label "declaration" ; rdfs:comment "When the event has already occured"@en. activity:unknownEvent a activity:event ; rdfs:label "unknown" ; rdfs:comment "When the event is unknown in the day, it is the default value"@en. activity:EnumIntensity a rdfs:Class . activity:lowLevel a activity:EnumIntensity ; rdfs:label "low" ; rdfs:comment "When the acitivity intent is low"@en. activity:moderateLevel a activity:EnumIntensity ; rdfs:label "moderate" ; rdfs:comment "When the acitivity intent is moderate"@en. activity:highLevel a activity:EnumIntensity ; rdfs:label "high" ; rdfs:comment "When the acitivity intent is high"@en. activity:intenseLevel a activity:EnumIntensity ; rdfs:label "intense" ; rdfs:comment "When the acitivity intent is intense"@en. activity:veryIntenseLevel a activity:EnumIntensity ; rdfs:label "very intense" ; rdfs:comment "When the acitivity intent is very intense"@en. activity:unknownLevel a activity:EnumIntensity ; rdfs:label "unknown" ; rdfs:comment "When the acitivity intent is unknown"@en. activity:intensity a owl:DatatypeProperty ; rdfs:label "intensity"@en; rdfs:comment "Sport or activity intensity"@en; rdfs:range activity:EnumIntensity . """ ========================================================================================= ------------------------------ LLM Raw response ----------------------------- ```json [ { "activity:name": "Course à pied" } ] ``` ----------------------------------------------------------------------------- ----------------- Make it compliant ------------------ ```json [ { "activity:name": "Course à pied" } ] ``` ------------------------------------------------------ ------------------------ After simplification ------------------------ [ { "activity:name": "Course à pied" }] ---------------------------------------------------------------------- --------------------------------- LLM result ----------------------------------- {'response': [{'activity:name': 'Course à pied'}], 'cost': 0.0} -------------------------------------------------------------------------------- Traceback (most recent call last): File "/home/debian/html/nutritwin/resources/KCALLMMainService.py", line 70, in omess = KCALLMMain.runEvent(event) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/debian/html/nutritwin/resources/KCALLMMain.py", line 134, in runEvent resp = KCALLMMainSpeechToData.execute(speech, image64, comment, appId, device, version, age, gender, longitude, latitude, test, llmid) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/debian/html/nutritwin/resources/KCALLMMainSpeechToData.py", line 39, in execute omess = executeLLMSingle(text, image64, comment, model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/debian/html/nutritwin/resources/KCALLMMainSpeechToData.py", line 241, in executeLLMSingle sols = KCALLMActivityUtilities.getBestSolutions(jresult["response"], jSports) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/debian/html/nutritwin/resources/KCALLMActivityUtilities.py", line 19, in getBestSolutions nameLLM = act["name"].lower() ~~~^^^^^^^^ KeyError: 'name'