{
 "meta": {
  "model": "llama3.2:latest",
  "load_s": 3.14,
  "peak_ram_mb_all_ollama": 2588,
  "ollama_ps": [
   {
    "name": "llama3.2:latest",
    "model": "llama3.2:latest",
    "size": 2561000078,
    "digest": "a80c4f17acd55265feec403c7aef86be0c25983ab279d83f3bcd3abbcb5b8b72",
    "details": {
     "parent_model": "",
     "format": "gguf",
     "family": "llama",
     "families": [
      "llama"
     ],
     "parameter_size": "3.2B",
     "quantization_level": "Q4_K_M"
    },
    "expires_at": "2026-10-25T01:44:39.437011+02:00",
    "size_vram": 2561000078,
    "context_length": 4096,
    "runner": "llamacpp"
   }
  ]
 },
 "rows": [
  {
   "id": "de01",
   "lang": "de",
   "q": "Wie viel Wasser sollte ich pro Person und Tag für den Notvorrat einplanen?",
   "retrieved": [
    {
     "id": "P01",
     "score": 0.7129
    },
    {
     "id": "DE1",
     "score": 0.6412
    },
    {
     "id": "P07",
     "score": 0.5665
    }
   ],
   "answer": "Für jeden Tag sollte man mindestens 1 Gallone (ca. 4 Litre) Wasser pro Person für Trinken und Hygiene speichern. Kinder, stillende Mütter und kranke Menschen benötigen möglicherweise mehr. [P01]",
   "perf": {
    "ttft_s": 1.89,
    "total_s": 3.52,
    "eval_tokens": 58,
    "tok_per_s": 35.6,
    "prompt_tokens": 523,
    "prompt_tok_per_s": 283.5
   },
   "score": {
    "refused": false,
    "cited": [
     "P01"
    ],
    "answer_lang": "de",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": [
     "1"
    ]
   }
  },
  {
   "id": "de02",
   "lang": "de",
   "q": "Wie klingt die Sirene bei einer Warnung und wie bei der Entwarnung?",
   "retrieved": [
    {
     "id": "DE2",
     "score": 0.6619
    },
    {
     "id": "P09",
     "score": 0.4994
    },
    {
     "id": "P16",
     "score": 0.4985
    }
   ],
   "answer": "Die Sirene klingt bei einer Warnung 1 Minute lang mit einem 1-minütigen, wiehlernden Tönchen. Bei der Entwarnung klingt die Sirene 1 Minute lang mit einem 1-minütigen, kontinuierlichen Tönchen. [DE2]",
   "perf": {
    "ttft_s": 0.89,
    "total_s": 2.92,
    "eval_tokens": 69,
    "tok_per_s": 34.0,
    "prompt_tokens": 516,
    "prompt_tok_per_s": 601.2
   },
   "score": {
    "refused": false,
    "cited": [
     "DE2"
    ],
    "answer_lang": "de",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": false,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "de03",
   "lang": "de",
   "q": "Darf ich bei einem Stromausfall den Campingkocher in der Küche benutzen, wenn ich das Fenster aufmache?",
   "retrieved": [
    {
     "id": "P19",
     "score": 0.5702
    },
    {
     "id": "P02",
     "score": 0.5563
    },
    {
     "id": "DE1",
     "score": 0.5098
    }
   ],
   "answer": "NEIN [DE1].",
   "perf": {
    "ttft_s": 0.93,
    "total_s": 1.13,
    "eval_tokens": 7,
    "tok_per_s": 34.9,
    "prompt_tokens": 532,
    "prompt_tok_per_s": 610.8
   },
   "score": {
    "refused": false,
    "cited": [
     "DE1"
    ],
    "answer_lang": "nl",
    "lang_ok": false,
    "refusal_ok": true,
    "hit_top1": false,
    "hit_top3": true,
    "citation_ok": false,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "de04",
   "lang": "de",
   "q": "Wie lange muss ich Wasser abkochen, damit es sicher trinkbar ist?",
   "retrieved": [
    {
     "id": "P04",
     "score": 0.6983
    },
    {
     "id": "P01",
     "score": 0.6205
    },
    {
     "id": "P05",
     "score": 0.6181
    }
   ],
   "answer": "Um Wasser sicher zu machen, um es zu trinken, muss es 1 Minute lang bei einem Rollbohrfeuer [P04] gekocht werden.",
   "perf": {
    "ttft_s": 0.82,
    "total_s": 1.86,
    "eval_tokens": 35,
    "tok_per_s": 33.6,
    "prompt_tokens": 484,
    "prompt_tok_per_s": 608.6
   },
   "score": {
    "refused": false,
    "cited": [
     "P04"
    ],
    "answer_lang": "de",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "de05",
   "lang": "de",
   "q": "Wie viele Tropfen Chlorbleiche gebe ich in 4 Liter Wasser?",
   "retrieved": [
    {
     "id": "P05",
     "score": 0.5995
    },
    {
     "id": "P01",
     "score": 0.5282
    },
    {
     "id": "P04",
     "score": 0.4709
    }
   ],
   "answer": "Für 4 Liter Wasser sollten 8 Tropfen Chlorbleiche (ca. 1/8 Teelöffel) verwendet werden. [P05]",
   "perf": {
    "ttft_s": 0.8,
    "total_s": 1.82,
    "eval_tokens": 34,
    "tok_per_s": 33.2,
    "prompt_tokens": 484,
    "prompt_tok_per_s": 629.3
   },
   "score": {
    "refused": false,
    "cited": [
     "P05"
    ],
    "answer_lang": "de",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "de06",
   "lang": "de",
   "q": "Woran erkenne ich eine Kohlenmonoxidvergiftung?",
   "retrieved": [
    {
     "id": "P03",
     "score": 0.6875
    },
    {
     "id": "P11",
     "score": 0.4826
    },
    {
     "id": "P09",
     "score": 0.4626
    }
   ],
   "answer": "Eine Kohlenmonoxidvergiftung kann durch Symptome wie Kopfschmerzen, Benommenheit, Schwäche, Magenprobleme, Erbrechen, Brustschmerzen und Verwirrung gekennzeichnet sein. Wenn Sie Verdacht auf eine Vergiftung haben, sollten Sie sofort die Luft räumen und die Notrufnummer anrufen. Installieren Sie auch Batteriebetriebene Kohlenmonoxiddetektoren. [P03]",
   "perf": {
    "ttft_s": 0.73,
    "total_s": 3.8,
    "eval_tokens": 103,
    "tok_per_s": 33.5,
    "prompt_tokens": 462,
    "prompt_tok_per_s": 662.9
   },
   "score": {
    "refused": false,
    "cited": [
     "P03"
    ],
    "answer_lang": "de",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "de07",
   "lang": "de",
   "q": "Jemand blutet stark am Bein. Wo genau lege ich das Tourniquet an?",
   "retrieved": [
    {
     "id": "P13",
     "score": 0.7135
    },
    {
     "id": "P11",
     "score": 0.4773
    },
    {
     "id": "P17",
     "score": 0.4664
    }
   ],
   "answer": "Wenn jemand stark am Bein blutet, solltest du ein Tourniquet 2 bis 3 Zoll (5 bis 7 Zentimeter) über dem Verletzungsort anlegen, nicht auf einer Gelenkstelle. [P13]",
   "perf": {
    "ttft_s": 0.83,
    "total_s": 2.87,
    "eval_tokens": 58,
    "tok_per_s": 28.3,
    "prompt_tokens": 490,
    "prompt_tok_per_s": 626.2
   },
   "score": {
    "refused": false,
    "cited": [
     "P13"
    ],
    "answer_lang": "de",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "de08",
   "lang": "de",
   "q": "Die Notrufnummern 110 und 112 funktionieren nicht mehr. Was soll ich in einem Notfall tun?",
   "retrieved": [
    {
     "id": "DE2",
     "score": 0.5555
    },
    {
     "id": "P18",
     "score": 0.5434
    },
    {
     "id": "DE1",
     "score": 0.4975
    }
   ],
   "answer": "Wenn die Notrufnummern 110 und 112 nicht mehr funktionieren, solltest du zu einem Polizeistation oder einem Krankenhaus gehen. [P01]",
   "perf": {
    "ttft_s": 0.88,
    "total_s": 2.12,
    "eval_tokens": 39,
    "tok_per_s": 31.5,
    "prompt_tokens": 593,
    "prompt_tok_per_s": 839.1
   },
   "score": {
    "refused": false,
    "cited": [
     "P01"
    ],
    "answer_lang": "de",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": false,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "de09",
   "lang": "de",
   "q": "Wie entferne ich eine Zecke richtig?",
   "retrieved": [
    {
     "id": "P16",
     "score": 0.4747
    },
    {
     "id": "P04",
     "score": 0.4668
    },
    {
     "id": "P05",
     "score": 0.4555
    }
   ],
   "answer": "Entfernen Sie die Zecke nicht selbst, sondern suchen Sie sofort medizinische Hilfe. [NOT_IN_LIBRARY] Zecken können Krankheiten übertragen, und es ist wichtig, professionelle Hilfe zu suchen.",
   "perf": {
    "ttft_s": 1.14,
    "total_s": 2.5,
    "eval_tokens": 45,
    "tok_per_s": 33.0,
    "prompt_tokens": 486,
    "prompt_tok_per_s": 619.7
   },
   "score": {
    "refused": true,
    "cited": [],
    "answer_lang": "de",
    "lang_ok": true,
    "refusal_ok": true
   }
  },
  {
   "id": "de10",
   "lang": "de",
   "q": "Kann ich mein Elektroauto bei einem Blackout als Notstrom für das Haus nutzen?",
   "retrieved": [
    {
     "id": "P19",
     "score": 0.5535
    },
    {
     "id": "P02",
     "score": 0.4636
    },
    {
     "id": "DE1",
     "score": 0.4585
    }
   ],
   "answer": "NEIN [P02]. Eine Elektroauto kann als Notstrom nicht direkt genutzt werden, da es eine elektrische Antriebseinheit hat, die nicht für den Hausgebrauch geeignet ist.",
   "perf": {
    "ttft_s": 0.91,
    "total_s": 2.2,
    "eval_tokens": 44,
    "tok_per_s": 34.0,
    "prompt_tokens": 521,
    "prompt_tok_per_s": 600.4
   },
   "score": {
    "refused": false,
    "cited": [
     "P02"
    ],
    "answer_lang": "de",
    "lang_ok": true,
    "refusal_ok": false
   }
  },
  {
   "id": "es01",
   "lang": "es",
   "q": "¿Cuánta agua tengo que guardar por persona y día para una emergencia?",
   "retrieved": [
    {
     "id": "P01",
     "score": 0.7751
    },
    {
     "id": "P07",
     "score": 0.6026
    },
    {
     "id": "P20",
     "score": 0.5953
    }
   ],
   "answer": "Debes guardar al menos un galón (aproximadamente 4 litros) de agua por persona por día, durante al menos tres días, para consumo y saneamiento. [P01]",
   "perf": {
    "ttft_s": 0.69,
    "total_s": 1.88,
    "eval_tokens": 42,
    "tok_per_s": 35.4,
    "prompt_tokens": 425,
    "prompt_tok_per_s": 681.4
   },
   "score": {
    "refused": false,
    "cited": [
     "P01"
    ],
    "answer_lang": "es",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "es02",
   "lang": "es",
   "q": "Tras el apagón volvió la luz a las 6 horas. ¿Tengo que tirar la carne y la leche de la nevera?",
   "retrieved": [
    {
     "id": "ES2",
     "score": 0.5648
    },
    {
     "id": "P06",
     "score": 0.5636
    },
    {
     "id": "P19",
     "score": 0.5563
    }
   ],
   "answer": "Sí, según la recomendación de la Agencia de Seguridad Alimentaria y Nutrición de España (AESAN), si el apagón duró más de 4 horas, la carne y la leche pueden haberse vuelto peligrosas para el consumo. Es recomendable tirarlas, incluso si se cocinan. [ES2]",
   "perf": {
    "ttft_s": 1.09,
    "total_s": 3.35,
    "eval_tokens": 77,
    "tok_per_s": 34.1,
    "prompt_tokens": 595,
    "prompt_tok_per_s": 562.4
   },
   "score": {
    "refused": false,
    "cited": [
     "ES2"
    ],
    "answer_lang": "fr",
    "lang_ok": false,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "es03",
   "lang": "es",
   "q": "¿Cuánto tiempo aguanta el congelador sin luz si no lo abro?",
   "retrieved": [
    {
     "id": "P06",
     "score": 0.6312
    },
    {
     "id": "ES2",
     "score": 0.5931
    },
    {
     "id": "P14",
     "score": 0.5015
    }
   ],
   "answer": "Según el pasaje [ES2], un congelador puede mantener su temperatura de congelación durante al menos 24 a 48 horas si las puertas se mantienen cerradas.",
   "perf": {
    "ttft_s": 1.17,
    "total_s": 2.37,
    "eval_tokens": 41,
    "tok_per_s": 34.2,
    "prompt_tokens": 589,
    "prompt_tok_per_s": 564.2
   },
   "score": {
    "refused": false,
    "cited": [
     "ES2"
    ],
    "answer_lang": "es",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "es04",
   "lang": "es",
   "q": "¿Puedo tener el generador funcionando en el garaje si dejo la puerta abierta?",
   "retrieved": [
    {
     "id": "P02",
     "score": 0.606
    },
    {
     "id": "P09",
     "score": 0.4541
    },
    {
     "id": "ES2",
     "score": 0.4044
    }
   ],
   "answer": "No, nunca. [P02]",
   "perf": {
    "ttft_s": 1.1,
    "total_s": 1.33,
    "eval_tokens": 9,
    "tok_per_s": 37.9,
    "prompt_tokens": 583,
    "prompt_tok_per_s": 559.6
   },
   "score": {
    "refused": false,
    "cited": [
     "P02"
    ],
    "answer_lang": "en",
    "lang_ok": false,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "es05",
   "lang": "es",
   "q": "¿Qué es ES-Alert y cómo me llegan los avisos?",
   "retrieved": [
    {
     "id": "ES1",
     "score": 0.5709
    },
    {
     "id": "P16",
     "score": 0.4167
    },
    {
     "id": "P08",
     "score": 0.4024
    }
   ],
   "answer": "ES-Alert es un sistema de alerta de emergencia en España. Los avisos se envían directamente a los teléfonos móviles de los usuarios inscritos en el sistema [ES1].",
   "perf": {
    "ttft_s": 1.1,
    "total_s": 2.4,
    "eval_tokens": 46,
    "tok_per_s": 35.4,
    "prompt_tokens": 566,
    "prompt_tok_per_s": 529.8
   },
   "score": {
    "refused": false,
    "cited": [
     "ES1"
    ],
    "answer_lang": "es",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "es06",
   "lang": "es",
   "q": "Huele a gas en casa. ¿Qué hago?",
   "retrieved": [
    {
     "id": "P09",
     "score": 0.7414
    },
    {
     "id": "P02",
     "score": 0.5626
    },
    {
     "id": "P18",
     "score": 0.5603
    }
   ],
   "answer": "Si huelas gas en casa, sal de inmediato y mantén la puerta abierta. No enciendas luces, interruptores eléctricos ni utilices un teléfono o una cerilla dentro. Llama a la compañía de gas o a la número de emergencia desde afuera, a una distancia segura. [P09]",
   "perf": {
    "ttft_s": 0.75,
    "total_s": 3.15,
    "eval_tokens": 79,
    "tok_per_s": 32.9,
    "prompt_tokens": 447,
    "prompt_tok_per_s": 651.0
   },
   "score": {
    "refused": false,
    "cited": [
     "P09"
    ],
    "answer_lang": "ro",
    "lang_ok": false,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "es07",
   "lang": "es",
   "q": "¿Con cuántos centímetros de agua en movimiento me puede tirar una inundación?",
   "retrieved": [
    {
     "id": "P10",
     "score": 0.6968
    },
    {
     "id": "P01",
     "score": 0.5628
    },
    {
     "id": "P04",
     "score": 0.5379
    }
   ],
   "answer": "6 centímetros [P10].",
   "perf": {
    "ttft_s": 0.82,
    "total_s": 1.05,
    "eval_tokens": 9,
    "tok_per_s": 38.8,
    "prompt_tokens": 478,
    "prompt_tok_per_s": 611.4
   },
   "score": {
    "refused": false,
    "cited": [
     "P10"
    ],
    "answer_lang": "nl",
    "lang_ok": false,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "es08",
   "lang": "es",
   "q": "¿Para cuántos días debo tener medicamentos con receta en casa?",
   "retrieved": [
    {
     "id": "P14",
     "score": 0.7255
    },
    {
     "id": "P01",
     "score": 0.5418
    },
    {
     "id": "P07",
     "score": 0.5154
    }
   ],
   "answer": "Debes tener al menos una semana de suministro de medicamentos con receta, más copias de las recetas y una lista de dosis. Verifica fechas de vencimiento periódicamente. [P14]\n\nNota: Si tienes medicamentos que requieren refrigeración, es posible que necesiten un refrigerador o bloques de hielo durante una caída de la electricidad; consulta con tu farmacéutico sobre cuánto tiempo permanecen útiles sin enfriamiento.",
   "perf": {
    "ttft_s": 0.63,
    "total_s": 3.96,
    "eval_tokens": 108,
    "tok_per_s": 32.5,
    "prompt_tokens": 431,
    "prompt_tok_per_s": 711.9
   },
   "score": {
    "refused": false,
    "cited": [
     "P14"
    ],
    "answer_lang": "fr",
    "lang_ok": false,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": false,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "es09",
   "lang": "es",
   "q": "¿Cómo puedo hacer potable el agua de mar?",
   "retrieved": [
    {
     "id": "P05",
     "score": 0.5531
    },
    {
     "id": "P04",
     "score": 0.5379
    },
    {
     "id": "P01",
     "score": 0.4983
    }
   ],
   "answer": "Para hacer el agua de mar potable, debes desalinizarla. Sin embargo, no tengo información en el libro sobre cómo hacerlo. [NOT_IN_LIBRARY] El libro no proporciona instrucciones sobre cómo desalinizar el agua de mar.",
   "perf": {
    "ttft_s": 0.83,
    "total_s": 2.44,
    "eval_tokens": 54,
    "tok_per_s": 33.5,
    "prompt_tokens": 478,
    "prompt_tok_per_s": 607.2
   },
   "score": {
    "refused": true,
    "cited": [],
    "answer_lang": "es",
    "lang_ok": true,
    "refusal_ok": true
   }
  },
  {
   "id": "es10",
   "lang": "es",
   "q": "¿Qué hago si me pica una medusa en la playa?",
   "retrieved": [
    {
     "id": "P16",
     "score": 0.4813
    },
    {
     "id": "P13",
     "score": 0.4729
    },
    {
     "id": "P10",
     "score": 0.4585
    }
   ],
   "answer": "Si te pica una medusa en la playa, NO aplicas presión directa sobre la herida. [P13] En su lugar, retira cualquier ropa o equipo que pueda estar en contacto con la herida y llama a los servicios de emergencia. No intentes sacar la espinilla de la piel, ya que esto puede empeorar la situación. [P16]",
   "perf": {
    "ttft_s": 0.59,
    "total_s": 3.31,
    "eval_tokens": 85,
    "tok_per_s": 31.3,
    "prompt_tokens": 480,
    "prompt_tok_per_s": 917.3
   },
   "score": {
    "refused": false,
    "cited": [
     "P13",
     "P16"
    ],
    "answer_lang": "fr",
    "lang_ok": false,
    "refusal_ok": false
   }
  },
  {
   "id": "pl01",
   "lang": "pl",
   "q": "Ile wody na osobę na dobę powinienem trzymać w zapasie?",
   "retrieved": [
    {
     "id": "P01",
     "score": 0.7057
    },
    {
     "id": "P04",
     "score": 0.5744
    },
    {
     "id": "PL1",
     "score": 0.5694
    }
   ],
   "answer": "Zapasy wody powinny wynosić co najmniej 1 galon (około 4 litry) na osobę na dobę, w celu zapewnienia dostępu do wody do trzech dni. [P01]",
   "perf": {
    "ttft_s": 0.89,
    "total_s": 2.51,
    "eval_tokens": 56,
    "tok_per_s": 34.7,
    "prompt_tokens": 538,
    "prompt_tok_per_s": 690.7
   },
   "score": {
    "refused": false,
    "cited": [
     "P01"
    ],
    "answer_lang": "pl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": [
     "1"
    ]
   }
  },
  {
   "id": "pl02",
   "lang": "pl",
   "q": "Na ile dni powinienem przygotować domowe zapasy?",
   "retrieved": [
    {
     "id": "PL1",
     "score": 0.6307
    },
    {
     "id": "P14",
     "score": 0.5877
    },
    {
     "id": "P07",
     "score": 0.5851
    }
   ],
   "answer": "Zgodnie z Poradnikiem bezpieczeństwa, powinieneś przygotować domowe zapasy na minimum 3 dni. [PL1]",
   "perf": {
    "ttft_s": 0.82,
    "total_s": 1.89,
    "eval_tokens": 38,
    "tok_per_s": 35.7,
    "prompt_tokens": 498,
    "prompt_tok_per_s": 632.0
   },
   "score": {
    "refused": false,
    "cited": [
     "PL1"
    ],
    "answer_lang": "pl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "pl03",
   "lang": "pl",
   "q": "Jak brzmi syrena przy ogłoszeniu alarmu, a jak przy jego odwołaniu?",
   "retrieved": [
    {
     "id": "PL2",
     "score": 0.6048
    },
    {
     "id": "P09",
     "score": 0.5106
    },
    {
     "id": "P16",
     "score": 0.494
    }
   ],
   "answer": "Symfonia alarmowa składa się z dwóch części: trwającej 3 minuty syreny alarmowej i syreny odwołania. Symfonia alarmowa składa się z dwóch części: trwającej 3 minuty syreny alarmowej i syreny odwołania. [PL2]",
   "perf": {
    "ttft_s": 0.95,
    "total_s": 3.8,
    "eval_tokens": 81,
    "tok_per_s": 28.4,
    "prompt_tokens": 518,
    "prompt_tok_per_s": 571.9
   },
   "score": {
    "refused": false,
    "cited": [
     "PL2"
    ],
    "answer_lang": "pl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "pl04",
   "lang": "pl",
   "q": "Czy mogę używać grilla na węgiel drzewny w mieszkaniu, kiedy nie ma prądu?",
   "retrieved": [
    {
     "id": "P02",
     "score": 0.5206
    },
    {
     "id": "P19",
     "score": 0.5153
    },
    {
     "id": "P06",
     "score": 0.4195
    }
   ],
   "answer": "Nie, nie wolno używać grilla na węgiel drzewny w mieszkaniu, kiedy nie ma prądu. [P02] Generators and carbon monoxide: Never run a generator, pressure washer, grill, camp stove or any gasoline-, propane- or charcoal-burning device inside a home, basement, garage or camper, even with doors and windows open.",
   "perf": {
    "ttft_s": 0.97,
    "total_s": 3.6,
    "eval_tokens": 83,
    "tok_per_s": 31.4,
    "prompt_tokens": 474,
    "prompt_tok_per_s": 868.7
   },
   "score": {
    "refused": false,
    "cited": [
     "P02"
    ],
    "answer_lang": "en",
    "lang_ok": false,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "pl05",
   "lang": "pl",
   "q": "Ile kropli wybielacza z chlorem dodać do 4 litrów wody?",
   "retrieved": [
    {
     "id": "P05",
     "score": 0.6384
    },
    {
     "id": "P04",
     "score": 0.4699
    },
    {
     "id": "P01",
     "score": 0.4545
    }
   ],
   "answer": "Do 4 litrów wody należy dodać 8 kropli wybielacza z chlorem (około 1/8 łyżki). [P05]",
   "perf": {
    "ttft_s": 0.28,
    "total_s": 1.8,
    "eval_tokens": 44,
    "tok_per_s": 29.0,
    "prompt_tokens": 493,
    "prompt_tok_per_s": 4861.3
   },
   "score": {
    "refused": false,
    "cited": [
     "P05"
    ],
    "answer_lang": "pl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "pl06",
   "lang": "pl",
   "q": "Jak długo pełna zamrażarka utrzyma mrożonki bez prądu?",
   "retrieved": [
    {
     "id": "P06",
     "score": 0.6446
    },
    {
     "id": "P14",
     "score": 0.5004
    },
    {
     "id": "P07",
     "score": 0.4654
    }
   ],
   "answer": "Zamrażarka pełna utrzyma mrożonki bez prądu około 48 godzin. [P07]",
   "perf": {
    "ttft_s": 1.0,
    "total_s": 2.1,
    "eval_tokens": 35,
    "tok_per_s": 31.8,
    "prompt_tokens": 468,
    "prompt_tok_per_s": 874.1
   },
   "score": {
    "refused": false,
    "cited": [
     "P07"
    ],
    "answer_lang": "nl",
    "lang_ok": false,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": false,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": [
     "48"
    ]
   }
  },
  {
   "id": "pl07",
   "lang": "pl",
   "q": "Ziemia się trzęsie. Czy mam wybiec na zewnątrz?",
   "retrieved": [
    {
     "id": "P17",
     "score": 0.6635
    },
    {
     "id": "P18",
     "score": 0.5753
    },
    {
     "id": "P10",
     "score": 0.5741
    }
   ],
   "answer": "Nie, nie wybiec na zewnątrz. [P17]",
   "perf": {
    "ttft_s": 0.77,
    "total_s": 1.34,
    "eval_tokens": 18,
    "tok_per_s": 31.4,
    "prompt_tokens": 454,
    "prompt_tok_per_s": 644.5
   },
   "score": {
    "refused": false,
    "cited": [
     "P17"
    ],
    "answer_lang": "pl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "pl08",
   "lang": "pl",
   "q": "Ktoś ma udar cieplny. Czy powinienem dać mu wody do picia?",
   "retrieved": [
    {
     "id": "P12",
     "score": 0.598
    },
    {
     "id": "P11",
     "score": 0.5673
    },
    {
     "id": "P01",
     "score": 0.5576
    }
   ],
   "answer": "Nie, nie powinien. [P11]",
   "perf": {
    "ttft_s": 0.85,
    "total_s": 1.22,
    "eval_tokens": 12,
    "tok_per_s": 32.6,
    "prompt_tokens": 497,
    "prompt_tok_per_s": 619.0
   },
   "score": {
    "refused": false,
    "cited": [
     "P11"
    ],
    "answer_lang": "de",
    "lang_ok": false,
    "refusal_ok": true,
    "hit_top1": false,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "pl09",
   "lang": "pl",
   "q": "Jak odróżnić grzyby jadalne od trujących w lesie?",
   "retrieved": [
    {
     "id": "P04",
     "score": 0.4201
    },
    {
     "id": "P02",
     "score": 0.4056
    },
    {
     "id": "P18",
     "score": 0.3944
    }
   ],
   "answer": "Oto kilka zasad, które mogą Ci pomóc:\n\n- Unikaj grzybów, które są zielone lub brązowe, ponieważ są często trujące.\n- Unikaj grzybów, które mają nieprzyjemny zapach lub smak.\n- Unikaj grzybów, które mają wyraźne barwy lub wzory.\n- Jeśli nie jesteś pewien, nie jeżuł.\n\nNiektóre grzyby jadalne to porzeczki, grzyby szpinawowe, ale niektóre z nich mogą być trujące. [P04]\n\nNie ma w bibliotece informacji o grzybach jadalnych w lesie.",
   "perf": {
    "ttft_s": 0.83,
    "total_s": 6.08,
    "eval_tokens": 165,
    "tok_per_s": 31.4,
    "prompt_tokens": 476,
    "prompt_tok_per_s": 599.5
   },
   "score": {
    "refused": false,
    "cited": [
     "P04"
    ],
    "answer_lang": "pl",
    "lang_ok": true,
    "refusal_ok": false
   }
  },
  {
   "id": "pl10",
   "lang": "pl",
   "q": "Ile tabletek jodku potasu mam wziąć po awarii elektrowni jądrowej?",
   "retrieved": [
    {
     "id": "P14",
     "score": 0.4396
    },
    {
     "id": "PL1",
     "score": 0.4238
    },
    {
     "id": "P11",
     "score": 0.4095
    }
   ],
   "answer": "Nie ma specjalnej ilości jodku potasu wskazanej w przypadku awarii elektrowni jądrowej. [P14]",
   "perf": {
    "ttft_s": 1.26,
    "total_s": 2.35,
    "eval_tokens": 36,
    "tok_per_s": 33.2,
    "prompt_tokens": 534,
    "prompt_tok_per_s": 673.2
   },
   "score": {
    "refused": false,
    "cited": [
     "P14"
    ],
    "answer_lang": "pl",
    "lang_ok": true,
    "refusal_ok": false
   }
  },
  {
   "id": "sv01",
   "lang": "sv",
   "q": "Hur mycket vatten behöver jag per person och dygn?",
   "retrieved": [
    {
     "id": "P01",
     "score": 0.6799
    },
    {
     "id": "SE1",
     "score": 0.5811
    },
    {
     "id": "P05",
     "score": 0.5654
    }
   ],
   "answer": "En person behöver minst 3 liters vatten per dag för drickande och kokning [SE1].",
   "perf": {
    "ttft_s": 1.6,
    "total_s": 2.39,
    "eval_tokens": 27,
    "tok_per_s": 34.3,
    "prompt_tokens": 531,
    "prompt_tok_per_s": 719.0
   },
   "score": {
    "refused": false,
    "cited": [
     "SE1"
    ],
    "answer_lang": "sv",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "sv02",
   "lang": "sv",
   "q": "När testas Hesa Fredrik?",
   "retrieved": [
    {
     "id": "SE2",
     "score": 0.5928
    },
    {
     "id": "P11",
     "score": 0.312
    },
    {
     "id": "SE1",
     "score": 0.3014
    }
   ],
   "answer": "Hesa Fredrik testas första gången på den första non-holiday-mondagen i mars, juni, september och december kl. 15:00 [SE2].",
   "perf": {
    "ttft_s": 1.63,
    "total_s": 2.8,
    "eval_tokens": 39,
    "tok_per_s": 33.2,
    "prompt_tokens": 616,
    "prompt_tok_per_s": 533.6
   },
   "score": {
    "refused": false,
    "cited": [
     "SE2"
    ],
    "answer_lang": "sv",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": false,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "sv03",
   "lang": "sv",
   "q": "Jag hör en signal som ljuder 7 sekunder och sedan är tyst 14 sekunder. Vad betyder det och vad ska jag göra?",
   "retrieved": [
    {
     "id": "SE2",
     "score": 0.5555
    },
    {
     "id": "P16",
     "score": 0.5122
    },
    {
     "id": "P09",
     "score": 0.5095
    }
   ],
   "answer": "Det är en signal från Sveriges outdoor warning system, Hesa Fredrik. Signalen betyder att det finns en fara för människor och föremål ute i naturen, t.ex. en skogsbrenning. Du ska gå in i huset, stänga fönstren och dörrarna, och om möjligt stänga av ventilationen. Lyssna sedan på Sveriges Radio P4 för ytterligare information. [SE2]",
   "perf": {
    "ttft_s": 0.64,
    "total_s": 4.05,
    "eval_tokens": 107,
    "tok_per_s": 31.4,
    "prompt_tokens": 559,
    "prompt_tok_per_s": 909.0
   },
   "score": {
    "refused": false,
    "cited": [
     "SE2"
    ],
    "answer_lang": "sv",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "sv04",
   "lang": "sv",
   "q": "Får jag använda gasolköket inne i köket när strömmen är borta, om jag öppnar ett fönster?",
   "retrieved": [
    {
     "id": "P02",
     "score": 0.5276
    },
    {
     "id": "P06",
     "score": 0.4776
    },
    {
     "id": "P19",
     "score": 0.4721
    }
   ],
   "answer": "NEVER [P02]. Generators och gas-burninga enheter ska alltid användas utomhus, minst 20 fot (6 meter) från fönster, dörrar och ventilatorer.",
   "perf": {
    "ttft_s": 0.76,
    "total_s": 2.18,
    "eval_tokens": 47,
    "tok_per_s": 33.1,
    "prompt_tokens": 476,
    "prompt_tok_per_s": 898.5
   },
   "score": {
    "refused": false,
    "cited": [
     "P02"
    ],
    "answer_lang": "sv",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": false,
    "unsupported_numbers": []
   }
  },
  {
   "id": "sv05",
   "lang": "sv",
   "q": "Hur länge håller ett stängt kylskåp maten kall vid strömavbrott?",
   "retrieved": [
    {
     "id": "P06",
     "score": 0.6905
    },
    {
     "id": "P14",
     "score": 0.5353
    },
    {
     "id": "P07",
     "score": 0.4946
    }
   ],
   "answer": "En stängd kylskåp håller maten kall i ca 4 timmar [P06].",
   "perf": {
    "ttft_s": 0.27,
    "total_s": 1.08,
    "eval_tokens": 26,
    "tok_per_s": 31.9,
    "prompt_tokens": 467,
    "prompt_tok_per_s": 4443.5
   },
   "score": {
    "refused": false,
    "cited": [
     "P06"
    ],
    "answer_lang": "nl",
    "lang_ok": false,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "sv06",
   "lang": "sv",
   "q": "Kan jag använda stearinljus när strömmen är borta?",
   "retrieved": [
    {
     "id": "P19",
     "score": 0.6458
    },
    {
     "id": "P14",
     "score": 0.472
    },
    {
     "id": "P06",
     "score": 0.4373
    }
   ],
   "answer": "Nein, du solltest stearinljus nicht använda, eftersom det kan uppföra elstöter och starta brand. [P19]",
   "perf": {
    "ttft_s": 0.91,
    "total_s": 2.06,
    "eval_tokens": 39,
    "tok_per_s": 34.1,
    "prompt_tokens": 451,
    "prompt_tok_per_s": 840.1
   },
   "score": {
    "refused": false,
    "cited": [
     "P19"
    ],
    "answer_lang": "sv",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": false,
    "unsupported_numbers": []
   }
  },
  {
   "id": "sv07",
   "lang": "sv",
   "q": "Hur länge ska jag koka vattnet om jag är på fjället, över 2 000 meter?",
   "retrieved": [
    {
     "id": "P04",
     "score": 0.6706
    },
    {
     "id": "P01",
     "score": 0.5453
    },
    {
     "id": "P06",
     "score": 0.5335
    }
   ],
   "answer": "Om du är på fjället, över 2 000 meter, ska du koka vattnet i 3 minuter. [P04]",
   "perf": {
    "ttft_s": 0.69,
    "total_s": 1.72,
    "eval_tokens": 33,
    "tok_per_s": 32.2,
    "prompt_tokens": 500,
    "prompt_tok_per_s": 828.1
   },
   "score": {
    "refused": false,
    "cited": [
     "P04"
    ],
    "answer_lang": "sv",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "sv08",
   "lang": "sv",
   "q": "Det brinner i huset och katten är kvar inne. Ska jag gå tillbaka in och hämta den?",
   "retrieved": [
    {
     "id": "P20",
     "score": 0.5691
    },
    {
     "id": "P18",
     "score": 0.5355
    },
    {
     "id": "P16",
     "score": 0.5328
    }
   ],
   "answer": "NEVER [P18].",
   "perf": {
    "ttft_s": 0.75,
    "total_s": 0.92,
    "eval_tokens": 7,
    "tok_per_s": 40.1,
    "prompt_tokens": 449,
    "prompt_tok_per_s": 639.1
   },
   "score": {
    "refused": false,
    "cited": [
     "P18"
    ],
    "answer_lang": "nl",
    "lang_ok": false,
    "refusal_ok": true,
    "hit_top1": false,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": false,
    "unsupported_numbers": []
   }
  },
  {
   "id": "sv09",
   "lang": "sv",
   "q": "Hur bygger jag ett eget skyddsrum i källaren?",
   "retrieved": [
    {
     "id": "P16",
     "score": 0.5109
    },
    {
     "id": "P17",
     "score": 0.4988
    },
    {
     "id": "P04",
     "score": 0.4456
    }
   ],
   "answer": "För att bygga ett eget skyddsrum i källaren, bör du följa dessa steg:\n\n* Välj en rumslig plats med minst ett fönster, men så nära som möjligt vid en vägg.\n* Lägg till en extra vägg av plast eller betong för att förstärka fönstren.\n* Anslut en luftfilter till dörren för att förhindra inandning av giftiga ämnen.\n* Se till att rummet är väl ventilat och har en källa till vatten och en elkälla.\n\n[NOT_IN_LIBRARY] Detta är inte en fördelaktig plats för ett skyddsrum.",
   "perf": {
    "ttft_s": 0.88,
    "total_s": 6.21,
    "eval_tokens": 158,
    "tok_per_s": 29.7,
    "prompt_tokens": 472,
    "prompt_tok_per_s": 902.5
   },
   "score": {
    "refused": true,
    "cited": [],
    "answer_lang": "sv",
    "lang_ok": true,
    "refusal_ok": true
   }
  },
  {
   "id": "sv10",
   "lang": "sv",
   "q": "Hur behandlar jag ett huggormsbett?",
   "retrieved": [
    {
     "id": "P13",
     "score": 0.4628
    },
    {
     "id": "P16",
     "score": 0.462
    },
    {
     "id": "P17",
     "score": 0.4459
    }
   ],
   "answer": "En huggormsbett är en typ av huggorm som kan orsaka allvarlig smärta och skada. [P13] Enligt passage P13 ska man för att behandla ett huggormsbett:\n\n* Kalla området kallt vatten eller en kall kompress\n* Ta bort huggormen med en pinne eller en huggormsrem\n* Använda en huggormsrem för att hålla huggormen fast\n* Använda en kall kompress för att minska smärtan\n\nDet är viktigt att man inte skär eller skärnar sig själv när man behandlar ett huggormsbett.",
   "perf": {
    "ttft_s": 1.12,
    "total_s": 7.15,
    "eval_tokens": 158,
    "tok_per_s": 26.3,
    "prompt_tokens": 466,
    "prompt_tok_per_s": 834.9
   },
   "score": {
    "refused": false,
    "cited": [
     "P13"
    ],
    "answer_lang": "sv",
    "lang_ok": true,
    "refusal_ok": false
   }
  },
  {
   "id": "cv_de",
   "lang": "de",
   "q": "Wie lange hält ein voller Gefrierschrank ohne Strom die Temperatur?",
   "retrieved": [
    {
     "id": "P06",
     "score": 0.6592
    },
    {
     "id": "P14",
     "score": 0.5011
    },
    {
     "id": "P07",
     "score": 0.4577
    }
   ],
   "answer": "Ein voller Gefrierschrank hält seine Temperatur für etwa 48 Stunden [P06].",
   "perf": {
    "ttft_s": 0.59,
    "total_s": 1.3,
    "eval_tokens": 22,
    "tok_per_s": 31.0,
    "prompt_tokens": 459,
    "prompt_tok_per_s": 3975.4
   },
   "score": {
    "refused": false,
    "cited": [
     "P06"
    ],
    "answer_lang": "de",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "cv_sv",
   "lang": "sv",
   "q": "Tack. Nu fortsätter jag på svenska: hur långt från huset ska elverket stå?",
   "retrieved": [
    {
     "id": "P02",
     "score": 0.5425
    },
    {
     "id": "P19",
     "score": 0.4842
    },
    {
     "id": "P10",
     "score": 0.4713
    }
   ],
   "answer": "En generator ska stå minst 20 fot (ca 6 meter) från fönster, dörrar och ventilatorer [P02].",
   "perf": {
    "ttft_s": 0.97,
    "total_s": 2.03,
    "eval_tokens": 33,
    "tok_per_s": 31.3,
    "prompt_tokens": 500,
    "prompt_tok_per_s": 728.0
   },
   "score": {
    "refused": false,
    "cited": [
     "P02"
    ],
    "answer_lang": "sv",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  },
  {
   "id": "cv_es",
   "lang": "es",
   "q": "Ahora en español: si el agua está turbia, ¿cuántas gotas de lejía pongo en 4 litros?",
   "retrieved": [
    {
     "id": "P05",
     "score": 0.5319
    },
    {
     "id": "P01",
     "score": 0.501
    },
    {
     "id": "P04",
     "score": 0.4686
    }
   ],
   "answer": "Si el agua está turbia, se deben agregar el doble de gotas de lejía, es decir, 16 gotas (aproximadamente 1/8 cucharadita) por 4 litros de agua [P05].",
   "perf": {
    "ttft_s": 1.31,
    "total_s": 3.25,
    "eval_tokens": 54,
    "tok_per_s": 27.9,
    "prompt_tokens": 612,
    "prompt_tok_per_s": 666.0
   },
   "score": {
    "refused": false,
    "cited": [
     "P05"
    ],
    "answer_lang": "es",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": [
     "16"
    ]
   }
  },
  {
   "id": "cv_pl",
   "lang": "pl",
   "q": "A teraz po polsku: czy przy hipotermii mogę dać komuś alkohol na rozgrzanie?",
   "retrieved": [
    {
     "id": "P12",
     "score": 0.6384
    },
    {
     "id": "P11",
     "score": 0.5264
    },
    {
     "id": "P04",
     "score": 0.4814
    }
   ],
   "answer": "Nie, nie dać alkoholu osobie z hipotermii [P12].",
   "perf": {
    "ttft_s": 1.46,
    "total_s": 2.23,
    "eval_tokens": 20,
    "tok_per_s": 26.0,
    "prompt_tokens": 735,
    "prompt_tok_per_s": 736.4
   },
   "score": {
    "refused": false,
    "cited": [
     "P12"
    ],
    "answer_lang": "pl",
    "lang_ok": true,
    "refusal_ok": true,
    "hit_top1": true,
    "hit_top3": true,
    "citation_ok": true,
    "must_ok": true,
    "neg_ok": true,
    "unsupported_numbers": []
   }
  }
 ]
}