[
  {
    "start": 0.08,
    "end": 1.12,
    "text": "Bugs are"
  },
  {
    "start": 2.08,
    "end": 3.44,
    "text": "I I would say like"
  },
  {
    "start": 3.6,
    "end": 4.72,
    "text": "invisible."
  },
  {
    "start": 4.72,
    "end": 5.76,
    "text": "Why invisible?"
  },
  {
    "start": 5.76,
    "end": 7.76,
    "text": "Because they are not in the code"
  },
  {
    "start": 8.66,
    "end": 10.98,
    "text": "In traditional testing everything is like"
  },
  {
    "start": 11.22,
    "end": 12.34,
    "text": "pass and fail."
  },
  {
    "start": 12.66,
    "end": 13.139,
    "text": "Input"
  },
  {
    "start": 13.3,
    "end": 14.02,
    "text": "output."
  },
  {
    "start": 14.02,
    "end": 14.74,
    "text": "But uh here"
  },
  {
    "start": 14.9,
    "end": 15.139,
    "text": "is"
  },
  {
    "start": 15.3,
    "end": 15.62,
    "text": "uh"
  },
  {
    "start": 16.42,
    "end": 16.66,
    "text": "uh"
  },
  {
    "start": 16.82,
    "end": 18.02,
    "text": "very different."
  },
  {
    "start": 18.02,
    "end": 18.26,
    "text": "Like"
  },
  {
    "start": 18.42,
    "end": 21.86,
    "text": "we have uh for the same input we have a lot of"
  },
  {
    "start": 22.02,
    "end": 27.3,
    "text": "different outputs, some of them can be similar, but uh yeah still"
  },
  {
    "start": 27.46,
    "end": 30.9,
    "text": "non-determinism is completely there."
  },
  {
    "start": 30.9,
    "end": 31.3,
    "text": "Uh"
  },
  {
    "start": 31.54,
    "end": 31.78,
    "text": "first"
  },
  {
    "start": 32.02,
    "end": 32.58,
    "text": "uh time"
  },
  {
    "start": 32.74,
    "end": 33.14,
    "text": "that uh"
  },
  {
    "start": 33.38,
    "end": 33.7,
    "text": "I"
  },
  {
    "start": 34.1,
    "end": 34.26,
    "text": "uh"
  },
  {
    "start": 34.42,
    "end": 35.86,
    "text": "saw the term stress"
  },
  {
    "start": 36.02,
    "end": 36.58,
    "text": "testing"
  },
  {
    "start": 36.84,
    "end": 39.48,
    "text": "In terms of uh testing Chad Bolt, I was like"
  },
  {
    "start": 39.719,
    "end": 41.96,
    "text": "performance testing?"
  },
  {
    "start": 41.96,
    "end": 43.399,
    "text": "No."
  },
  {
    "start": 43.399,
    "end": 43.64,
    "text": "But"
  },
  {
    "start": 43.879,
    "end": 46.44,
    "text": "no, of course, stress testing for Chad Bolt"
  },
  {
    "start": 46.68,
    "end": 47.879,
    "text": "testing is uh"
  },
  {
    "start": 48.199,
    "end": 48.44,
    "text": "uh"
  },
  {
    "start": 48.6,
    "end": 49.879,
    "text": "like uh checking"
  },
  {
    "start": 50.12,
    "end": 51.32,
    "text": "misspelling some biggest"
  },
  {
    "start": 51.92,
    "end": 52.559,
    "text": "terms,"
  },
  {
    "start": 53.12,
    "end": 54.079,
    "text": "some typos"
  },
  {
    "start": 54.32,
    "end": 54.399,
    "text": ","
  },
  {
    "start": 54.719,
    "end": 55.039,
    "text": "some"
  },
  {
    "start": 55.199,
    "end": 56.719,
    "text": "bad wording that"
  },
  {
    "start": 56.879,
    "end": 58.239,
    "text": "usually user"
  },
  {
    "start": 58.64,
    "end": 59.28,
    "text": "can use"
  },
  {
    "start": 59.6,
    "end": 62.64,
    "text": "during some frustration moments."
  },
  {
    "start": 63.079,
    "end": 65.0,
    "text": "Yeah, some magic tool."
  },
  {
    "start": 65.0,
    "end": 66.2,
    "text": "I didn't find it"
  },
  {
    "start": 66.439,
    "end": 67.08,
    "text": "actually"
  },
  {
    "start": 67.64,
    "end": 67.96,
    "text": "that"
  },
  {
    "start": 68.2,
    "end": 68.36,
    "text": "is"
  },
  {
    "start": 68.6,
    "end": 71.159,
    "text": "doing everything instead of me."
  },
  {
    "start": 71.159,
    "end": 73.56,
    "text": "Yeah, I I'm joking a bit, but uh"
  },
  {
    "start": 73.72,
    "end": 75.96,
    "text": "yes, I I think uh we are missing"
  },
  {
    "start": 76.2,
    "end": 77.56,
    "text": "tools still."
  },
  {
    "start": 77.84,
    "end": 81.28,
    "text": "Good tools that are doing the stuff."
  },
  {
    "start": 81.92,
    "end": 92.159,
    "text": "Welcome to Software Testing Unleashed, the podcast for testers, developers and test automation engineers and all the people in the software development process who want to create."
  },
  {
    "start": 92.439,
    "end": 92.68,
    "text": "Great"
  },
  {
    "start": 92.84,
    "end": 94.6,
    "text": "amazing quality software."
  },
  {
    "start": 94.6,
    "end": 100.679,
    "text": "My today's episode was recorded at TestWarez, a great testing conference in Poland."
  },
  {
    "start": 100.679,
    "end": 101.64,
    "text": "The days were full"
  },
  {
    "start": 101.799,
    "end": 107.159,
    "text": "packed with great quality content, and I had a great time discussing and chatting with the Poland."
  },
  {
    "start": 107.6,
    "end": 110.079,
    "text": "And the international software test community."
  },
  {
    "start": 110.079,
    "end": 115.679,
    "text": "If you haven't been here, you should definitely go to one of the next Test Warriors conferences."
  },
  {
    "start": 115.679,
    "end": 118.479,
    "text": "You'll find a link to the conference in the show notes."
  },
  {
    "start": 118.479,
    "end": 121.039,
    "text": "My guest today is Dusanka Lecic."
  },
  {
    "start": 121.039,
    "end": 121.439,
    "text": "She is a test"
  },
  {
    "start": 121.6,
    "end": 122.0,
    "text": "lead in"
  },
  {
    "start": 122.439,
    "end": 128.92,
    "text": "Department manager specialized in performance testing, agile methodologies, and engineering excellence."
  },
  {
    "start": 128.92,
    "end": 130.44,
    "text": "We talk today about"
  },
  {
    "start": 130.599,
    "end": 132.04,
    "text": "how to test a chatbot."
  },
  {
    "start": 132.04,
    "end": 137.0,
    "text": "Dusanka shares with us her experiences on testing a chatbot, how to set"
  },
  {
    "start": 137.36,
    "end": 139.84,
    "text": "Set up such a test, how to deal with prompting"
  },
  {
    "start": 140.0,
    "end": 140.959,
    "text": "and so on."
  },
  {
    "start": 140.959,
    "end": 141.44,
    "text": "And now"
  },
  {
    "start": 141.68,
    "end": 143.28,
    "text": "enjoy the episode"
  },
  {
    "start": 153.379,
    "end": 153.54,
    "text": "Hi"
  },
  {
    "start": 153.7,
    "end": 156.58,
    "text": "Dusanka, great to have you here on the show."
  },
  {
    "start": 156.9,
    "end": 157.7,
    "text": "Thank you."
  },
  {
    "start": 157.7,
    "end": 158.819,
    "text": "Thank you very much."
  },
  {
    "start": 158.98,
    "end": 160.98,
    "text": "I'm happy to be here"
  },
  {
    "start": 161.14,
    "end": 161.38,
    "text": "and"
  },
  {
    "start": 161.54,
    "end": 163.78,
    "text": "to share some knowledge."
  },
  {
    "start": 163.64,
    "end": 165.64,
    "text": "uh and uh my expertise."
  },
  {
    "start": 165.64,
    "end": 166.439,
    "text": "Yeah that's great."
  },
  {
    "start": 166.439,
    "end": 169.799,
    "text": "We had uh we I had the opportunity to have lunch with you today."
  },
  {
    "start": 169.879,
    "end": 170.76,
    "text": "Yes we had"
  },
  {
    "start": 171.079,
    "end": 171.959,
    "text": "very nice time."
  },
  {
    "start": 172.2,
    "end": 172.599,
    "text": "Yeah it was"
  },
  {
    "start": 172.76,
    "end": 172.84,
    "text": "was"
  },
  {
    "start": 173.0,
    "end": 175.319,
    "text": "great to to talk and chatting around"
  },
  {
    "start": 175.06,
    "end": 176.659,
    "text": "And we are here at the Testvores"
  },
  {
    "start": 176.819,
    "end": 177.14,
    "text": "uh comp"
  },
  {
    "start": 177.379,
    "end": 177.54,
    "text": "com"
  },
  {
    "start": 177.7,
    "end": 178.34,
    "text": "conference."
  },
  {
    "start": 178.34,
    "end": 180.18,
    "text": "It's uh a great nice conference."
  },
  {
    "start": 180.18,
    "end": 181.22,
    "text": "I like it very much here."
  },
  {
    "start": 181.22,
    "end": 182.579,
    "text": "I'm very happy to be here."
  },
  {
    "start": 182.579,
    "end": 183.7,
    "text": "My first time."
  },
  {
    "start": 183.78,
    "end": 184.34,
    "text": "Yes."
  },
  {
    "start": 184.34,
    "end": 184.659,
    "text": "Uh"
  },
  {
    "start": 184.819,
    "end": 188.659,
    "text": "I'm uh very pleased that I'm also for the first time here"
  },
  {
    "start": 188.819,
    "end": 189.299,
    "text": "and uh"
  },
  {
    "start": 189.64,
    "end": 191.239,
    "text": "People are really great, uh"
  },
  {
    "start": 191.48,
    "end": 192.28,
    "text": "crowded."
  },
  {
    "start": 193.56,
    "end": 196.36,
    "text": "Sometimes, like on conferences, I really like"
  },
  {
    "start": 196.519,
    "end": 197.0,
    "text": "crowd"
  },
  {
    "start": 197.319,
    "end": 199.56,
    "text": "and it's amazing, different people"
  },
  {
    "start": 199.92,
    "end": 200.4,
    "text": "different"
  },
  {
    "start": 200.56,
    "end": 200.8,
    "text": "uh"
  },
  {
    "start": 200.96,
    "end": 201.84,
    "text": "knowledges, uh"
  },
  {
    "start": 202.0,
    "end": 204.64,
    "text": "different perspectives about everything."
  },
  {
    "start": 204.64,
    "end": 206.16,
    "text": "I really like it here"
  },
  {
    "start": 206.32,
    "end": 206.72,
    "text": "and uh"
  },
  {
    "start": 206.88,
    "end": 208.0,
    "text": "this is not just"
  },
  {
    "start": 208.32,
    "end": 209.6,
    "text": "My first conference"
  },
  {
    "start": 210.16,
    "end": 210.4,
    "text": "in"
  },
  {
    "start": 210.56,
    "end": 212.8,
    "text": "terms of representing my company"
  },
  {
    "start": 212.96,
    "end": 213.2,
    "text": "Levi"
  },
  {
    "start": 213.52,
    "end": 214.08,
    "text": "9."
  },
  {
    "start": 214.08,
    "end": 214.56,
    "text": "I'm"
  },
  {
    "start": 216.2,
    "end": 216.44,
    "text": "So"
  },
  {
    "start": 216.6,
    "end": 217.08,
    "text": "and so"
  },
  {
    "start": 217.24,
    "end": 219.24,
    "text": "on on the conferences and uh"
  },
  {
    "start": 219.4,
    "end": 224.68,
    "text": "try to uh learn something from different guys that are here and also to share"
  },
  {
    "start": 225.18,
    "end": 229.5,
    "text": "Yeah, yeah, that that's always a good good reason to to be on such a conference here."
  },
  {
    "start": 229.5,
    "end": 230.06,
    "text": "Yeah."
  },
  {
    "start": 230.3,
    "end": 231.66,
    "text": "I read in your abstract"
  },
  {
    "start": 231.819,
    "end": 232.62,
    "text": "in the program"
  },
  {
    "start": 232.86,
    "end": 233.42,
    "text": "here uh"
  },
  {
    "start": 233.66,
    "end": 236.62,
    "text": "you were dealing with testing of chatbots"
  },
  {
    "start": 236.86,
    "end": 241.18,
    "text": "And I said, ooh, we have to talk about this in the in the podcast too"
  },
  {
    "start": 241.34,
    "end": 241.5,
    "text": "because"
  },
  {
    "start": 241.9,
    "end": 242.22,
    "text": "uh"
  },
  {
    "start": 242.54,
    "end": 243.739,
    "text": "it's it's it's the"
  },
  {
    "start": 243.98,
    "end": 244.3,
    "text": "I think"
  },
  {
    "start": 244.459,
    "end": 245.819,
    "text": "the primary reason uh uh"
  },
  {
    "start": 245.98,
    "end": 247.739,
    "text": "when we see a chatbot and we think"
  },
  {
    "start": 247.9,
    "end": 248.06,
    "text": "about"
  },
  {
    "start": 248.22,
    "end": 248.38,
    "text": "our"
  },
  {
    "start": 248.7,
    "end": 249.18,
    "text": "klassical"
  },
  {
    "start": 249.42,
    "end": 250.94,
    "text": "traditional test cases"
  },
  {
    "start": 251.24,
    "end": 254.76,
    "text": "Put something in, get something out that doesn't work."
  },
  {
    "start": 254.92,
    "end": 256.2,
    "text": "Exactly."
  },
  {
    "start": 259.94,
    "end": 260.18,
    "text": "Uh"
  },
  {
    "start": 260.34,
    "end": 263.54,
    "text": "for me it was very interesting, very challenging"
  },
  {
    "start": 263.78,
    "end": 264.34,
    "text": "because uh"
  },
  {
    "start": 264.5,
    "end": 268.34,
    "text": "I think majority of the people, especially in IT, uh"
  },
  {
    "start": 268.5,
    "end": 270.26,
    "text": "thinking about the chat boats"
  },
  {
    "start": 270.42,
    "end": 270.74,
    "text": "like"
  },
  {
    "start": 271.22,
    "end": 272.58,
    "text": "Yeah, I put"
  },
  {
    "start": 272.74,
    "end": 275.78,
    "text": "some question, I got some answer."
  },
  {
    "start": 275.78,
    "end": 277.22,
    "text": "I don't care about"
  },
  {
    "start": 277.54,
    "end": 279.78,
    "text": "it, but we are not uh"
  },
  {
    "start": 280.02,
    "end": 280.18,
    "text": "uh"
  },
  {
    "start": 280.419,
    "end": 282.18,
    "text": "deep diving in it"
  },
  {
    "start": 282.76,
    "end": 285.16,
    "text": "What if answer is not correct?"
  },
  {
    "start": 285.56,
    "end": 285.96,
    "text": "And uh"
  },
  {
    "start": 286.12,
    "end": 287.16,
    "text": "on some questions"
  },
  {
    "start": 287.32,
    "end": 289.64,
    "text": "we are not familiar with the answers"
  },
  {
    "start": 289.8,
    "end": 290.12,
    "text": "and"
  },
  {
    "start": 290.52,
    "end": 293.08,
    "text": "Do not know is it correct or no."
  },
  {
    "start": 293.56,
    "end": 293.8,
    "text": "And"
  },
  {
    "start": 293.96,
    "end": 294.6,
    "text": "uh yes"
  },
  {
    "start": 294.76,
    "end": 294.92,
    "text": "is"
  },
  {
    "start": 295.08,
    "end": 295.64,
    "text": "uh very"
  },
  {
    "start": 295.88,
    "end": 298.52,
    "text": "uh different uh from traditional testing."
  },
  {
    "start": 298.52,
    "end": 300.92,
    "text": "In traditional testing everything is like"
  },
  {
    "start": 301.12,
    "end": 301.36,
    "text": "pass"
  },
  {
    "start": 301.599,
    "end": 302.319,
    "text": "and fail."
  },
  {
    "start": 302.639,
    "end": 303.039,
    "text": "Input"
  },
  {
    "start": 303.199,
    "end": 303.919,
    "text": "output."
  },
  {
    "start": 303.919,
    "end": 304.08,
    "text": "But"
  },
  {
    "start": 304.4,
    "end": 304.72,
    "text": "here"
  },
  {
    "start": 304.879,
    "end": 305.039,
    "text": "is"
  },
  {
    "start": 305.199,
    "end": 305.52,
    "text": "uh"
  },
  {
    "start": 306.319,
    "end": 306.479,
    "text": "uh"
  },
  {
    "start": 306.72,
    "end": 306.96,
    "text": "very"
  },
  {
    "start": 307.199,
    "end": 307.919,
    "text": "different."
  },
  {
    "start": 307.919,
    "end": 308.879,
    "text": "Like we have uh"
  },
  {
    "start": 309.039,
    "end": 310.319,
    "text": "for the same input"
  },
  {
    "start": 310.479,
    "end": 313.28,
    "text": "we have a lot of different outputs."
  },
  {
    "start": 313.28,
    "end": 315.759,
    "text": "Some of them can be similar."
  },
  {
    "start": 315.98,
    "end": 317.26,
    "text": "But uh yeah, still"
  },
  {
    "start": 317.42,
    "end": 320.06,
    "text": "non-determinism is completely there."
  },
  {
    "start": 320.06,
    "end": 320.3,
    "text": "So"
  },
  {
    "start": 320.54,
    "end": 320.86,
    "text": "we"
  },
  {
    "start": 321.02,
    "end": 323.02,
    "text": "uh have in traditional testing"
  },
  {
    "start": 323.26,
    "end": 327.26,
    "text": "one valid case, others are like negative."
  },
  {
    "start": 327.02,
    "end": 327.18,
    "text": "test"
  },
  {
    "start": 327.42,
    "end": 328.06,
    "text": "cases"
  },
  {
    "start": 328.38,
    "end": 328.94,
    "text": "but uh"
  },
  {
    "start": 329.18,
    "end": 329.82,
    "text": "in uh"
  },
  {
    "start": 330.14,
    "end": 333.74,
    "text": "this uh testing chatbot uh we have many valid"
  },
  {
    "start": 333.9,
    "end": 335.34,
    "text": "test cases."
  },
  {
    "start": 335.56,
    "end": 335.88,
    "text": "And"
  },
  {
    "start": 336.12,
    "end": 338.68,
    "text": "we need to be careful about it actually."
  },
  {
    "start": 339.32,
    "end": 339.56,
    "text": "So"
  },
  {
    "start": 339.8,
    "end": 339.96,
    "text": "let"
  },
  {
    "start": 340.12,
    "end": 340.68,
    "text": "let's uh"
  },
  {
    "start": 340.92,
    "end": 343.08,
    "text": "structure that a little bit and and look into"
  },
  {
    "start": 343.24,
    "end": 343.48,
    "text": "it."
  },
  {
    "start": 347.74,
    "end": 350.78,
    "text": "to to get good tests there and the good quality"
  },
  {
    "start": 351.1,
    "end": 352.46,
    "text": "information out of that"
  },
  {
    "start": 352.94,
    "end": 355.9,
    "text": "that is a very interesting question now for me"
  },
  {
    "start": 356.14,
    "end": 356.46,
    "text": "because"
  },
  {
    "start": 356.62,
    "end": 356.86,
    "text": "uh"
  },
  {
    "start": 357.18,
    "end": 359.1,
    "text": "when I started to to test"
  },
  {
    "start": 359.26,
    "end": 360.22,
    "text": "jackboat"
  },
  {
    "start": 360.34,
    "end": 360.74,
    "text": "I was"
  },
  {
    "start": 360.98,
    "end": 361.22,
    "text": "like"
  },
  {
    "start": 361.46,
    "end": 361.78,
    "text": "like"
  },
  {
    "start": 362.26,
    "end": 364.5,
    "text": "majority of the people, uh"
  },
  {
    "start": 364.66,
    "end": 366.1,
    "text": "but then uh I figure"
  },
  {
    "start": 366.34,
    "end": 368.58,
    "text": "out that uh I need to deep dive"
  },
  {
    "start": 368.74,
    "end": 369.7,
    "text": "what is under"
  },
  {
    "start": 370.26,
    "end": 370.58,
    "text": "that"
  },
  {
    "start": 370.92,
    "end": 371.56,
    "text": "query"
  },
  {
    "start": 371.8,
    "end": 375.8,
    "text": "under that question that I'm putting in the chatbot."
  },
  {
    "start": 376.36,
    "end": 380.84,
    "text": "To deep dive in chunks, to deep dive uh in queries, in the"
  },
  {
    "start": 381.0,
    "end": 382.2,
    "text": "in prompts."
  },
  {
    "start": 382.66,
    "end": 385.46,
    "text": "in chunking strategies, in uh"
  },
  {
    "start": 385.7,
    "end": 389.22,
    "text": "everything that is uh completely, I think, uh"
  },
  {
    "start": 389.86,
    "end": 392.18,
    "text": "still unfamiliar to majority"
  },
  {
    "start": 393.28,
    "end": 395.12,
    "text": "And and how how did you do that?"
  },
  {
    "start": 395.6,
    "end": 397.92,
    "text": "How was your approach to this?"
  },
  {
    "start": 398.24,
    "end": 400.48,
    "text": "First approach was completely manually"
  },
  {
    "start": 400.72,
    "end": 403.52,
    "text": "because I'm not familiar with it."
  },
  {
    "start": 403.58,
    "end": 403.82,
    "text": "So"
  },
  {
    "start": 404.06,
    "end": 406.7,
    "text": "I started from a small parts."
  },
  {
    "start": 406.7,
    "end": 407.58,
    "text": "Okay?"
  },
  {
    "start": 407.58,
    "end": 408.7,
    "text": "What I want"
  },
  {
    "start": 409.02,
    "end": 410.62,
    "text": "from this chat boat."
  },
  {
    "start": 410.62,
    "end": 412.22,
    "text": "I want to have some"
  },
  {
    "start": 412.54,
    "end": 416.38,
    "text": "accuracy, correctness, some relevance."
  },
  {
    "start": 416.42,
    "end": 417.06,
    "text": "I want"
  },
  {
    "start": 417.22,
    "end": 420.58,
    "text": "to see that he's answering me correctly."
  },
  {
    "start": 421.06,
    "end": 422.42,
    "text": "I thought about uh"
  },
  {
    "start": 422.58,
    "end": 423.38,
    "text": "first uh like"
  },
  {
    "start": 423.54,
    "end": 426.42,
    "text": "some human needs, what I really want."
  },
  {
    "start": 426.42,
    "end": 427.38,
    "text": "I I want"
  },
  {
    "start": 428.0,
    "end": 428.24,
    "text": "uh"
  },
  {
    "start": 428.48,
    "end": 431.04,
    "text": "to not repeat some things uh"
  },
  {
    "start": 431.28,
    "end": 431.92,
    "text": "I want"
  },
  {
    "start": 432.08,
    "end": 432.4,
    "text": "uh"
  },
  {
    "start": 432.64,
    "end": 434.32,
    "text": "to not be frustrated."
  },
  {
    "start": 434.32,
    "end": 436.16,
    "text": "That is I think the most important"
  },
  {
    "start": 436.84,
    "end": 440.84,
    "text": "Because I I think uh everyone felt it in one moment with uh"
  },
  {
    "start": 441.0,
    "end": 442.44,
    "text": "with chatbots."
  },
  {
    "start": 442.44,
    "end": 444.76,
    "text": "But then of course after that uh"
  },
  {
    "start": 444.92,
    "end": 448.92,
    "text": "there is a lot of technical things that uh we need to cover"
  },
  {
    "start": 449.039,
    "end": 451.039,
    "text": "in the sense of uh testing chem"
  },
  {
    "start": 451.199,
    "end": 452.0,
    "text": "checkboat"
  },
  {
    "start": 452.56,
    "end": 452.879,
    "text": "sorry"
  },
  {
    "start": 453.12,
    "end": 454.159,
    "text": "chatboats."
  },
  {
    "start": 455.28,
    "end": 455.52,
    "text": "So"
  },
  {
    "start": 455.68,
    "end": 458.639,
    "text": "first of all uh I started to think about"
  },
  {
    "start": 459.12,
    "end": 460.96,
    "text": "What is chunking?"
  },
  {
    "start": 460.96,
    "end": 462.639,
    "text": "How I get chunks?"
  },
  {
    "start": 462.96,
    "end": 466.639,
    "text": "Do I need to do it manually, automatically?"
  },
  {
    "start": 466.96,
    "end": 468.24,
    "text": "How to do it?"
  },
  {
    "start": 468.24,
    "end": 469.44,
    "text": "Is it good enough"
  },
  {
    "start": 469.599,
    "end": 470.879,
    "text": "or no?"
  },
  {
    "start": 470.639,
    "end": 470.72,
    "text": "uh"
  },
  {
    "start": 470.88,
    "end": 474.24,
    "text": "what are the semantic boundaries that we are putting"
  },
  {
    "start": 474.4,
    "end": 474.72,
    "text": "uh"
  },
  {
    "start": 474.96,
    "end": 475.28,
    "text": "like"
  },
  {
    "start": 475.52,
    "end": 475.84,
    "text": "to"
  },
  {
    "start": 476.16,
    "end": 476.479,
    "text": "uh"
  },
  {
    "start": 476.639,
    "end": 480.16,
    "text": "improve our chunking strategies uh and so on"
  },
  {
    "start": 480.32,
    "end": 481.199,
    "text": "so what are"
  },
  {
    "start": 481.62,
    "end": 481.86,
    "text": "Uh"
  },
  {
    "start": 482.02,
    "end": 482.659,
    "text": "actually"
  },
  {
    "start": 482.9,
    "end": 483.06,
    "text": "uh"
  },
  {
    "start": 483.22,
    "end": 484.819,
    "text": "when I first time uh"
  },
  {
    "start": 485.139,
    "end": 485.46,
    "text": "uh"
  },
  {
    "start": 485.699,
    "end": 486.819,
    "text": "saw a term"
  },
  {
    "start": 487.139,
    "end": 487.379,
    "text": "rag"
  },
  {
    "start": 487.86,
    "end": 489.379,
    "text": "system, I was like"
  },
  {
    "start": 489.82,
    "end": 492.14,
    "text": "What is that and do I need it?"
  },
  {
    "start": 492.14,
    "end": 493.1,
    "text": "Yes, of course."
  },
  {
    "start": 493.1,
    "end": 494.7,
    "text": "Most of the chat boats"
  },
  {
    "start": 494.94,
    "end": 495.18,
    "text": "uh"
  },
  {
    "start": 495.5,
    "end": 497.1,
    "text": "is uh built uh on"
  },
  {
    "start": 497.5,
    "end": 498.3,
    "text": "base uh of"
  },
  {
    "start": 498.54,
    "end": 498.78,
    "text": "rag"
  },
  {
    "start": 499.02,
    "end": 499.26,
    "text": "system"
  },
  {
    "start": 499.58,
    "end": 500.86,
    "text": "and we need to"
  },
  {
    "start": 501.02,
    "end": 501.66,
    "text": "uh have"
  },
  {
    "start": 502.139,
    "end": 502.38,
    "text": "So"
  },
  {
    "start": 502.54,
    "end": 505.259,
    "text": "retrieval logic, we need to test it."
  },
  {
    "start": 505.259,
    "end": 505.5,
    "text": "So"
  },
  {
    "start": 505.66,
    "end": 507.18,
    "text": "not just response."
  },
  {
    "start": 507.18,
    "end": 509.419,
    "text": "Response is important, but also"
  },
  {
    "start": 509.66,
    "end": 511.5,
    "text": "what we are retrieving."
  },
  {
    "start": 511.58,
    "end": 513.02,
    "text": "What is our prompt?"
  },
  {
    "start": 513.74,
    "end": 513.9,
    "text": "what"
  },
  {
    "start": 514.06,
    "end": 516.14,
    "text": "we need to fix in one moment, uh"
  },
  {
    "start": 516.3,
    "end": 518.38,
    "text": "how to trace, uh, uh"
  },
  {
    "start": 518.62,
    "end": 520.219,
    "text": "how to retest."
  },
  {
    "start": 520.62,
    "end": 522.38,
    "text": "So a lot of things are"
  },
  {
    "start": 522.62,
    "end": 522.94,
    "text": "uh"
  },
  {
    "start": 524.24,
    "end": 524.88,
    "text": "Like"
  },
  {
    "start": 525.36,
    "end": 525.68,
    "text": "were"
  },
  {
    "start": 526.0,
    "end": 529.68,
    "text": "first unfamiliar to me and I started to discovering"
  },
  {
    "start": 530.079,
    "end": 530.319,
    "text": "uh"
  },
  {
    "start": 530.56,
    "end": 530.88,
    "text": "and"
  },
  {
    "start": 531.04,
    "end": 533.279,
    "text": "it was uh starting to be"
  },
  {
    "start": 533.44,
    "end": 535.2,
    "text": "Very interesting, like uh"
  },
  {
    "start": 535.52,
    "end": 535.84,
    "text": "I"
  },
  {
    "start": 536.08,
    "end": 538.24,
    "text": "uh found uh some uh good"
  },
  {
    "start": 538.56,
    "end": 539.52,
    "text": "uh things"
  },
  {
    "start": 539.68,
    "end": 540.24,
    "text": "that uh"
  },
  {
    "start": 540.4,
    "end": 540.72,
    "text": "like"
  },
  {
    "start": 540.88,
    "end": 541.2,
    "text": "uh"
  },
  {
    "start": 541.52,
    "end": 543.92,
    "text": "were a challenge for me, uh"
  },
  {
    "start": 544.08,
    "end": 544.32,
    "text": "like"
  },
  {
    "start": 544.64,
    "end": 546.8,
    "text": "vector embeddings, how to test"
  },
  {
    "start": 547.12,
    "end": 547.76,
    "text": "them."
  },
  {
    "start": 547.92,
    "end": 549.12,
    "text": "What I expect"
  },
  {
    "start": 549.279,
    "end": 549.6,
    "text": "uh"
  },
  {
    "start": 550.0,
    "end": 550.319,
    "text": "uh"
  },
  {
    "start": 550.56,
    "end": 551.759,
    "text": "is that good enough"
  },
  {
    "start": 552.0,
    "end": 553.12,
    "text": "or no?"
  },
  {
    "start": 553.12,
    "end": 553.36,
    "text": "Uh"
  },
  {
    "start": 553.6,
    "end": 555.6,
    "text": "how to write some uh test"
  },
  {
    "start": 555.839,
    "end": 558.88,
    "text": "cases, how to produce negative test scenario"
  },
  {
    "start": 559.52,
    "end": 559.92,
    "text": "Uh"
  },
  {
    "start": 560.16,
    "end": 560.4,
    "text": "first"
  },
  {
    "start": 560.64,
    "end": 561.2,
    "text": "uh time"
  },
  {
    "start": 561.36,
    "end": 562.24,
    "text": "that uh I"
  },
  {
    "start": 562.72,
    "end": 565.28,
    "text": "uh saw the term stress testing"
  },
  {
    "start": 565.52,
    "end": 567.52,
    "text": "in terms of uh testing chat boat"
  },
  {
    "start": 567.68,
    "end": 568.16,
    "text": "I was like"
  },
  {
    "start": 568.32,
    "end": 569.76,
    "text": "performance testing"
  },
  {
    "start": 570.56,
    "end": 571.44,
    "text": "No."
  },
  {
    "start": 572.0,
    "end": 572.32,
    "text": "But"
  },
  {
    "start": 572.48,
    "end": 576.16,
    "text": "no, of course, stress testing for chatbot testing is uh"
  },
  {
    "start": 576.8,
    "end": 577.04,
    "text": "uh"
  },
  {
    "start": 577.2,
    "end": 577.76,
    "text": "like uh"
  },
  {
    "start": 578.0,
    "end": 578.56,
    "text": "checking"
  },
  {
    "start": 578.72,
    "end": 580.32,
    "text": "misspellings, ambiguous"
  },
  {
    "start": 580.48,
    "end": 581.44,
    "text": "terms, uh"
  },
  {
    "start": 581.839,
    "end": 583.6,
    "text": "Some typos, some"
  },
  {
    "start": 583.839,
    "end": 585.279,
    "text": "bad wording that"
  },
  {
    "start": 585.44,
    "end": 586.0,
    "text": "usually"
  },
  {
    "start": 586.24,
    "end": 586.639,
    "text": "user"
  },
  {
    "start": 587.199,
    "end": 587.839,
    "text": "can use"
  },
  {
    "start": 588.16,
    "end": 590.639,
    "text": "during some frustration moments."
  },
  {
    "start": 591.52,
    "end": 593.52,
    "text": "So you you you looked deep into"
  },
  {
    "start": 593.76,
    "end": 595.6,
    "text": "into the the chatbot and and and"
  },
  {
    "start": 595.84,
    "end": 597.84,
    "text": "clustered it in different areas."
  },
  {
    "start": 597.84,
    "end": 598.24,
    "text": "What you look"
  },
  {
    "start": 598.48,
    "end": 598.56,
    "text": "so"
  },
  {
    "start": 598.72,
    "end": 598.88,
    "text": "who"
  },
  {
    "start": 599.16,
    "end": 602.68,
    "text": "When I what I understand is that you build your own test strategy by"
  },
  {
    "start": 602.84,
    "end": 607.64,
    "text": "by researching what is inside this chatbot and how can you cluster that."
  },
  {
    "start": 607.72,
    "end": 610.12,
    "text": "Uh yeah I tried to divide it, uh"
  },
  {
    "start": 610.36,
    "end": 613.48,
    "text": "not just like my own strategy, but uh"
  },
  {
    "start": 613.72,
    "end": 615.4,
    "text": "I had some small like"
  },
  {
    "start": 615.88,
    "end": 616.84,
    "text": "framework"
  },
  {
    "start": 617.0,
    "end": 617.64,
    "text": "more than"
  },
  {
    "start": 617.96,
    "end": 618.28,
    "text": "uh"
  },
  {
    "start": 618.44,
    "end": 618.76,
    "text": "more"
  },
  {
    "start": 618.92,
    "end": 619.48,
    "text": "like uh"
  },
  {
    "start": 619.64,
    "end": 620.6,
    "text": "guidance"
  },
  {
    "start": 621.079,
    "end": 621.399,
    "text": "uh"
  },
  {
    "start": 621.8,
    "end": 623.24,
    "text": "for my testing"
  },
  {
    "start": 624.199,
    "end": 624.519,
    "text": "what"
  },
  {
    "start": 624.839,
    "end": 625.16,
    "text": "is"
  },
  {
    "start": 625.48,
    "end": 626.12,
    "text": "really important"
  },
  {
    "start": 626.759,
    "end": 627.399,
    "text": "for me"
  },
  {
    "start": 627.72,
    "end": 628.279,
    "text": "like uh"
  },
  {
    "start": 628.44,
    "end": 630.44,
    "text": "to preserve the context"
  },
  {
    "start": 630.9,
    "end": 631.22,
    "text": "So"
  },
  {
    "start": 631.38,
    "end": 632.34,
    "text": "if I have"
  },
  {
    "start": 632.5,
    "end": 633.3,
    "text": "multi-turn"
  },
  {
    "start": 633.54,
    "end": 638.98,
    "text": "interactions with chatboat, I want to remember what I said before."
  },
  {
    "start": 638.98,
    "end": 640.9,
    "text": "I don't want to repeat"
  },
  {
    "start": 640.839,
    "end": 643.88,
    "text": "Myself and I want to preserve the context."
  },
  {
    "start": 643.88,
    "end": 645.959,
    "text": "Context is very important."
  },
  {
    "start": 645.959,
    "end": 647.56,
    "text": "Not just content."
  },
  {
    "start": 647.56,
    "end": 648.44,
    "text": "We are uh"
  },
  {
    "start": 648.6,
    "end": 650.68,
    "text": "we need to mix those things."
  },
  {
    "start": 650.68,
    "end": 650.839,
    "text": "Uh"
  },
  {
    "start": 651.0,
    "end": 651.319,
    "text": "also"
  },
  {
    "start": 651.72,
    "end": 653.0,
    "text": "that is like uh"
  },
  {
    "start": 653.5,
    "end": 653.819,
    "text": "uh"
  },
  {
    "start": 654.38,
    "end": 654.94,
    "text": "that uh"
  },
  {
    "start": 655.259,
    "end": 658.54,
    "text": "especially framework is a chat framework"
  },
  {
    "start": 658.86,
    "end": 659.019,
    "text": "but"
  },
  {
    "start": 659.18,
    "end": 659.5,
    "text": "yeah"
  },
  {
    "start": 659.74,
    "end": 660.54,
    "text": "with dots"
  },
  {
    "start": 660.86,
    "end": 661.42,
    "text": "like ch"
  },
  {
    "start": 661.98,
    "end": 662.3,
    "text": "eight"
  },
  {
    "start": 663.46,
    "end": 664.66,
    "text": "Like first of all,"
  },
  {
    "start": 664.98,
    "end": 665.3,
    "text": "C"
  },
  {
    "start": 665.54,
    "end": 665.86,
    "text": "is"
  },
  {
    "start": 666.18,
    "end": 666.82,
    "text": "context"
  },
  {
    "start": 667.7,
    "end": 668.58,
    "text": "retention"
  },
  {
    "start": 668.82,
    "end": 669.22,
    "text": "that is"
  },
  {
    "start": 669.38,
    "end": 670.02,
    "text": "really important"
  },
  {
    "start": 670.66,
    "end": 672.34,
    "text": "age for hallucination"
  },
  {
    "start": 672.58,
    "end": 673.46,
    "text": "control."
  },
  {
    "start": 673.62,
    "end": 673.86,
    "text": "So"
  },
  {
    "start": 674.18,
    "end": 674.5,
    "text": "we"
  },
  {
    "start": 674.74,
    "end": 676.74,
    "text": "really don't want to have some made"
  },
  {
    "start": 676.899,
    "end": 677.7,
    "text": "up facts,"
  },
  {
    "start": 678.1,
    "end": 678.42,
    "text": "some"
  },
  {
    "start": 678.66,
    "end": 680.5,
    "text": "uh misleading uh"
  },
  {
    "start": 681.459,
    "end": 682.5,
    "text": "answers."
  },
  {
    "start": 683.42,
    "end": 683.66,
    "text": "A"
  },
  {
    "start": 683.98,
    "end": 689.42,
    "text": "for accuracy and relevance, so we need correctness, we need some relevant answers."
  },
  {
    "start": 689.42,
    "end": 690.699,
    "text": "I don't want uh any"
  },
  {
    "start": 690.94,
    "end": 691.66,
    "text": "fact."
  },
  {
    "start": 691.64,
    "end": 693.56,
    "text": "I don't want any answer."
  },
  {
    "start": 693.56,
    "end": 694.12,
    "text": "I want"
  },
  {
    "start": 694.36,
    "end": 697.0,
    "text": "answer on my question and that is also"
  },
  {
    "start": 697.32,
    "end": 697.64,
    "text": "really"
  },
  {
    "start": 697.96,
    "end": 698.52,
    "text": "important."
  },
  {
    "start": 698.52,
    "end": 699.08,
    "text": "And T"
  },
  {
    "start": 699.32,
    "end": 701.24,
    "text": "is uh for testing workflow."
  },
  {
    "start": 701.24,
    "end": 703.24,
    "text": "What is testing workflow here"
  },
  {
    "start": 703.44,
    "end": 703.6,
    "text": "So"
  },
  {
    "start": 703.76,
    "end": 705.28,
    "text": "to trace everything"
  },
  {
    "start": 705.52,
    "end": 706.48,
    "text": "to fix"
  },
  {
    "start": 706.72,
    "end": 707.76,
    "text": "what is wrong"
  },
  {
    "start": 708.0,
    "end": 709.92,
    "text": "and of course to retest."
  },
  {
    "start": 709.92,
    "end": 711.76,
    "text": "We need to retest things"
  },
  {
    "start": 712.0,
    "end": 712.24,
    "text": "with"
  },
  {
    "start": 712.48,
    "end": 714.88,
    "text": "some similar or same queries"
  },
  {
    "start": 715.04,
    "end": 715.36,
    "text": "that"
  },
  {
    "start": 715.52,
    "end": 716.24,
    "text": "we tested"
  },
  {
    "start": 716.48,
    "end": 716.72,
    "text": "first"
  },
  {
    "start": 716.88,
    "end": 717.12,
    "text": "time"
  },
  {
    "start": 717.28,
    "end": 717.6,
    "text": "before"
  },
  {
    "start": 717.76,
    "end": 718.64,
    "text": "fixing."
  },
  {
    "start": 719.12,
    "end": 719.92,
    "text": "And and uh w"
  },
  {
    "start": 720.08,
    "end": 720.56,
    "text": "when I think"
  },
  {
    "start": 720.72,
    "end": 721.68,
    "text": "I I didn't uh"
  },
  {
    "start": 721.84,
    "end": 722.0,
    "text": "uh"
  },
  {
    "start": 722.24,
    "end": 722.48,
    "text": "test"
  },
  {
    "start": 722.64,
    "end": 724.0,
    "text": "the chatbot up to"
  },
  {
    "start": 724.24,
    "end": 726.4,
    "text": "now, so but I think it's it's uh"
  },
  {
    "start": 726.56,
    "end": 729.52,
    "text": "it could be sometimes not easy to say if an"
  },
  {
    "start": 729.94,
    "end": 730.1,
    "text": "if"
  },
  {
    "start": 730.34,
    "end": 730.58,
    "text": "the"
  },
  {
    "start": 730.74,
    "end": 731.3,
    "text": "the result"
  },
  {
    "start": 731.46,
    "end": 732.42,
    "text": "I get, not"
  },
  {
    "start": 732.74,
    "end": 734.1,
    "text": "especially from Jetpot, but"
  },
  {
    "start": 734.26,
    "end": 735.3,
    "text": "also insight."
  },
  {
    "start": 735.3,
    "end": 735.54,
    "text": "Uh"
  },
  {
    "start": 735.78,
    "end": 737.38,
    "text": "if it's correct"
  },
  {
    "start": 737.54,
    "end": 738.019,
    "text": "in the main"
  },
  {
    "start": 738.18,
    "end": 738.42,
    "text": "of"
  },
  {
    "start": 738.58,
    "end": 740.74,
    "text": "in the thing of our quality thinking."
  },
  {
    "start": 740.74,
    "end": 741.22,
    "text": "So uh"
  },
  {
    "start": 741.38,
    "end": 745.779,
    "text": "maybe I I I I would suggest there are more answers I get out there than"
  },
  {
    "start": 745.94,
    "end": 747.94,
    "text": "than I I get uh really uh uh"
  },
  {
    "start": 748.1,
    "end": 749.54,
    "text": "knowledge out of that."
  },
  {
    "start": 749.7,
    "end": 750.019,
    "text": "Yes"
  },
  {
    "start": 750.18,
    "end": 750.98,
    "text": "you are really"
  },
  {
    "start": 751.44,
    "end": 751.6,
    "text": "uh"
  },
  {
    "start": 751.76,
    "end": 753.6,
    "text": "correct with with this uh"
  },
  {
    "start": 753.84,
    "end": 754.48,
    "text": "thinking"
  },
  {
    "start": 754.88,
    "end": 755.04,
    "text": "uh"
  },
  {
    "start": 755.2,
    "end": 756.88,
    "text": "it is very hard to say"
  },
  {
    "start": 757.04,
    "end": 757.44,
    "text": "yeah"
  },
  {
    "start": 757.6,
    "end": 760.0,
    "text": "this is tested and this is okay"
  },
  {
    "start": 760.16,
    "end": 761.28,
    "text": "and for me uh"
  },
  {
    "start": 761.44,
    "end": 764.0,
    "text": "I think it's best uh to to use"
  },
  {
    "start": 764.16,
    "end": 764.48,
    "text": "uh"
  },
  {
    "start": 764.92,
    "end": 765.079,
    "text": "uh"
  },
  {
    "start": 765.24,
    "end": 765.48,
    "text": "like"
  },
  {
    "start": 765.639,
    "end": 770.199,
    "text": "a combined approach, uh hybrid approach, manual testing, so"
  },
  {
    "start": 770.36,
    "end": 772.279,
    "text": "we need really to to know"
  },
  {
    "start": 772.44,
    "end": 773.88,
    "text": "what is going on under"
  },
  {
    "start": 774.04,
    "end": 777.399,
    "text": "the questions, under the queries, under the responses"
  },
  {
    "start": 777.56,
    "end": 777.88,
    "text": "and"
  },
  {
    "start": 778.04,
    "end": 779.16,
    "text": "retrievals"
  },
  {
    "start": 779.48,
    "end": 783.08,
    "text": "so to understand everything uh to check everything"
  },
  {
    "start": 783.24,
    "end": 784.12,
    "text": "it's very"
  },
  {
    "start": 784.36,
    "end": 785.24,
    "text": "consumption"
  },
  {
    "start": 785.48,
    "end": 787.08,
    "text": "like time consuming"
  },
  {
    "start": 787.32,
    "end": 787.88,
    "text": "and uh"
  },
  {
    "start": 788.04,
    "end": 788.92,
    "text": "of course uh"
  },
  {
    "start": 789.08,
    "end": 789.72,
    "text": "we also"
  },
  {
    "start": 790.32,
    "end": 790.48,
    "text": "have"
  },
  {
    "start": 790.72,
    "end": 791.68,
    "text": "uh that uh"
  },
  {
    "start": 792.0,
    "end": 792.64,
    "text": "automated"
  },
  {
    "start": 792.96,
    "end": 794.4,
    "text": "part that is really important"
  },
  {
    "start": 794.72,
    "end": 797.28,
    "text": "that makes our lives much easier."
  },
  {
    "start": 797.68,
    "end": 798.72,
    "text": "And in terms also"
  },
  {
    "start": 798.88,
    "end": 800.08,
    "text": "chatbot testing."
  },
  {
    "start": 800.08,
    "end": 800.96,
    "text": "Yeah yeah"
  },
  {
    "start": 801.14,
    "end": 805.3,
    "text": "And how do you deal with documentation in this stuff to to make it"
  },
  {
    "start": 805.7,
    "end": 806.02,
    "text": "uh"
  },
  {
    "start": 806.34,
    "end": 809.94,
    "text": "repeatable and and to to know what you have done?"
  },
  {
    "start": 809.86,
    "end": 809.94,
    "text": "in"
  },
  {
    "start": 810.1,
    "end": 810.18,
    "text": "uh"
  },
  {
    "start": 810.34,
    "end": 812.26,
    "text": "in your testing workflows and so"
  },
  {
    "start": 812.66,
    "end": 813.54,
    "text": "it's also"
  },
  {
    "start": 813.78,
    "end": 816.58,
    "text": "it's a bit harder than we usually uh"
  },
  {
    "start": 816.74,
    "end": 817.06,
    "text": "think"
  },
  {
    "start": 817.22,
    "end": 817.46,
    "text": "because"
  },
  {
    "start": 817.7,
    "end": 818.82,
    "text": "now we have uh"
  },
  {
    "start": 819.06,
    "end": 819.38,
    "text": "more"
  },
  {
    "start": 819.839,
    "end": 820.0,
    "text": "uh"
  },
  {
    "start": 820.24,
    "end": 821.519,
    "text": "valid uh test uh"
  },
  {
    "start": 821.68,
    "end": 822.88,
    "text": "scenarios, uh"
  },
  {
    "start": 823.12,
    "end": 823.44,
    "text": "more"
  },
  {
    "start": 823.6,
    "end": 826.0,
    "text": "positive test cases, and uh"
  },
  {
    "start": 826.16,
    "end": 826.56,
    "text": "yeah"
  },
  {
    "start": 826.72,
    "end": 829.759,
    "text": "usually some uh tools that we can use"
  },
  {
    "start": 829.92,
    "end": 830.16,
    "text": "uh"
  },
  {
    "start": 830.399,
    "end": 830.72,
    "text": "in"
  },
  {
    "start": 831.4,
    "end": 836.12,
    "text": "terms of uh creating test scenarios are useful."
  },
  {
    "start": 836.12,
    "end": 836.68,
    "text": "Uh"
  },
  {
    "start": 837.0,
    "end": 837.32,
    "text": "do"
  },
  {
    "start": 837.56,
    "end": 837.88,
    "text": "we"
  },
  {
    "start": 838.44,
    "end": 839.0,
    "text": "automate"
  },
  {
    "start": 839.32,
    "end": 839.64,
    "text": "it"
  },
  {
    "start": 839.92,
    "end": 841.839,
    "text": "Yes, we always can automate"
  },
  {
    "start": 842.0,
    "end": 842.319,
    "text": "also"
  },
  {
    "start": 842.8,
    "end": 843.44,
    "text": "that part"
  },
  {
    "start": 843.68,
    "end": 843.92,
    "text": "and"
  },
  {
    "start": 844.079,
    "end": 844.639,
    "text": "uh make"
  },
  {
    "start": 844.8,
    "end": 847.759,
    "text": "our life a bit easier in terms of"
  },
  {
    "start": 848.02,
    "end": 848.5,
    "text": "creating"
  },
  {
    "start": 848.82,
    "end": 850.9,
    "text": "creating documentation."
  },
  {
    "start": 851.3,
    "end": 852.26,
    "text": "Because I think"
  },
  {
    "start": 853.54,
    "end": 853.86,
    "text": "also"
  },
  {
    "start": 854.1,
    "end": 858.34,
    "text": "our colleague here, one of the speakers, Mitko, mentioned"
  },
  {
    "start": 858.62,
    "end": 858.86,
    "text": "uh"
  },
  {
    "start": 859.1,
    "end": 859.5,
    "text": "and uh"
  },
  {
    "start": 859.66,
    "end": 862.54,
    "text": "he had a very interesting story uh"
  },
  {
    "start": 862.7,
    "end": 863.42,
    "text": "about AI"
  },
  {
    "start": 863.74,
    "end": 864.54,
    "text": "also."
  },
  {
    "start": 864.54,
    "end": 864.779,
    "text": "Um"
  },
  {
    "start": 865.26,
    "end": 866.38,
    "text": "so everything that"
  },
  {
    "start": 866.82,
    "end": 867.7,
    "text": "You can use"
  },
  {
    "start": 867.94,
    "end": 869.62,
    "text": "help of AI, use"
  },
  {
    "start": 869.78,
    "end": 870.18,
    "text": "it."
  },
  {
    "start": 870.18,
    "end": 870.82,
    "text": "It really"
  },
  {
    "start": 870.98,
    "end": 872.1,
    "text": "saves time."
  },
  {
    "start": 872.1,
    "end": 874.5,
    "text": "In terms of test plans, but"
  },
  {
    "start": 875.06,
    "end": 879.06,
    "text": "It's not so different from traditional testing."
  },
  {
    "start": 879.22,
    "end": 881.54,
    "text": "Majority, I think,"
  },
  {
    "start": 881.94,
    "end": 882.18,
    "text": "like"
  },
  {
    "start": 882.42,
    "end": 883.06,
    "text": "differences"
  },
  {
    "start": 883.38,
    "end": 883.7,
    "text": "are"
  },
  {
    "start": 883.86,
    "end": 888.02,
    "text": "actually in those valid test cases that we need."
  },
  {
    "start": 887.74,
    "end": 888.7,
    "text": "to have more"
  },
  {
    "start": 888.94,
    "end": 889.26,
    "text": "than"
  },
  {
    "start": 889.5,
    "end": 889.82,
    "text": "uh"
  },
  {
    "start": 890.22,
    "end": 891.34,
    "text": "in traditional"
  },
  {
    "start": 891.5,
    "end": 891.9,
    "text": "where is"
  },
  {
    "start": 892.06,
    "end": 894.06,
    "text": "just one valid test case."
  },
  {
    "start": 894.7,
    "end": 895.82,
    "text": "Did you use any"
  },
  {
    "start": 897.0,
    "end": 900.12,
    "text": "Literature research paper or something like that to get"
  },
  {
    "start": 900.28,
    "end": 901.56,
    "text": "into the how to test"
  },
  {
    "start": 901.72,
    "end": 903.32,
    "text": "a uh a chatpot"
  },
  {
    "start": 904.14,
    "end": 904.38,
    "text": "Uh"
  },
  {
    "start": 904.54,
    "end": 905.1,
    "text": "actually"
  },
  {
    "start": 905.26,
    "end": 906.46,
    "text": "I read uh"
  },
  {
    "start": 906.7,
    "end": 908.22,
    "text": "a lot of things."
  },
  {
    "start": 908.22,
    "end": 908.3,
    "text": "Uh"
  },
  {
    "start": 908.7,
    "end": 911.34,
    "text": "I cannot even remember everything"
  },
  {
    "start": 911.66,
    "end": 912.38,
    "text": "and uh"
  },
  {
    "start": 912.759,
    "end": 915.48,
    "text": "Because I was not uh the only girl"
  },
  {
    "start": 915.639,
    "end": 915.959,
    "text": "uh"
  },
  {
    "start": 916.12,
    "end": 917.399,
    "text": "in in the team."
  },
  {
    "start": 917.399,
    "end": 917.56,
    "text": "Uh"
  },
  {
    "start": 917.8,
    "end": 918.519,
    "text": "we have uh"
  },
  {
    "start": 918.68,
    "end": 919.959,
    "text": "more team members"
  },
  {
    "start": 920.12,
    "end": 920.759,
    "text": "and we"
  },
  {
    "start": 921.04,
    "end": 922.399,
    "text": "searched a lot of things"
  },
  {
    "start": 922.56,
    "end": 922.959,
    "text": "like uh"
  },
  {
    "start": 923.12,
    "end": 923.76,
    "text": "news some"
  },
  {
    "start": 924.0,
    "end": 924.88,
    "text": "articles uh"
  },
  {
    "start": 925.04,
    "end": 925.6,
    "text": "researcher"
  },
  {
    "start": 926.16,
    "end": 927.44,
    "text": "researching uh"
  },
  {
    "start": 927.76,
    "end": 928.399,
    "text": "papers"
  },
  {
    "start": 928.64,
    "end": 928.959,
    "text": "uh"
  },
  {
    "start": 929.6,
    "end": 929.76,
    "text": "some"
  },
  {
    "start": 930.08,
    "end": 930.4,
    "text": "um"
  },
  {
    "start": 930.72,
    "end": 932.32,
    "text": "slits, some uh"
  },
  {
    "start": 932.88,
    "end": 933.44,
    "text": "konference"
  },
  {
    "start": 933.6,
    "end": 934.48,
    "text": "speech, uh"
  },
  {
    "start": 934.64,
    "end": 934.96,
    "text": "everything"
  },
  {
    "start": 935.2,
    "end": 935.6,
    "text": "was in"
  },
  {
    "start": 935.92,
    "end": 936.32,
    "text": "the game"
  },
  {
    "start": 936.8,
    "end": 936.96,
    "text": "uh"
  },
  {
    "start": 937.12,
    "end": 937.52,
    "text": "to get"
  },
  {
    "start": 937.68,
    "end": 939.36,
    "text": "more and more understanding"
  },
  {
    "start": 939.52,
    "end": 939.76,
    "text": "and"
  },
  {
    "start": 940.08,
    "end": 940.64,
    "text": "information"
  },
  {
    "start": 940.8,
    "end": 941.36,
    "text": "and trying"
  },
  {
    "start": 941.52,
    "end": 942.16,
    "text": "to implement"
  },
  {
    "start": 942.4,
    "end": 943.2,
    "text": "everything"
  },
  {
    "start": 944.019,
    "end": 944.26,
    "text": "about"
  },
  {
    "start": 944.5,
    "end": 944.74,
    "text": "it"
  },
  {
    "start": 944.899,
    "end": 945.22,
    "text": "like"
  },
  {
    "start": 946.5,
    "end": 946.74,
    "text": "about"
  },
  {
    "start": 947.06,
    "end": 948.66,
    "text": "overlapping, about"
  },
  {
    "start": 949.06,
    "end": 950.019,
    "text": "topkey"
  },
  {
    "start": 950.42,
    "end": 953.779,
    "text": "scores that we have for different chunks, about"
  },
  {
    "start": 954.019,
    "end": 956.18,
    "text": "those unknown things."
  },
  {
    "start": 956.579,
    "end": 958.899,
    "text": "that uh were unfamiliar to us."
  },
  {
    "start": 958.899,
    "end": 960.18,
    "text": "But a lot of things"
  },
  {
    "start": 960.899,
    "end": 961.22,
    "text": "uh"
  },
  {
    "start": 961.54,
    "end": 965.94,
    "text": "you need to be familiar first, to read it, to research it, to"
  },
  {
    "start": 966.339,
    "end": 966.5,
    "text": "uh"
  },
  {
    "start": 966.66,
    "end": 970.259,
    "text": "search of uh what kind of database we need, why vector"
  },
  {
    "start": 970.5,
    "end": 973.54,
    "text": "database uh and what is so specific and"
  },
  {
    "start": 974.339,
    "end": 974.579,
    "text": "so on"
  },
  {
    "start": 974.94,
    "end": 975.18,
    "text": "And"
  },
  {
    "start": 975.34,
    "end": 976.46,
    "text": "when you did your older test"
  },
  {
    "start": 976.62,
    "end": 977.58,
    "text": "stuff, what were were"
  },
  {
    "start": 977.74,
    "end": 977.98,
    "text": "the"
  },
  {
    "start": 978.14,
    "end": 978.78,
    "text": "typical"
  },
  {
    "start": 979.42,
    "end": 979.66,
    "text": "uh"
  },
  {
    "start": 979.82,
    "end": 979.98,
    "text": "uh"
  },
  {
    "start": 980.22,
    "end": 984.3,
    "text": "errors and failures, bugs you find in in in the chatbot?"
  },
  {
    "start": 985.54,
    "end": 987.86,
    "text": "Not at all, actually."
  },
  {
    "start": 988.1,
    "end": 989.94,
    "text": "You know, in traditional testing"
  },
  {
    "start": 990.1,
    "end": 993.3,
    "text": "we are always finding errors in the code."
  },
  {
    "start": 993.3,
    "end": 996.1,
    "text": "Then we are doing our debugging"
  },
  {
    "start": 996.4,
    "end": 996.64,
    "text": "uh"
  },
  {
    "start": 997.04,
    "end": 997.36,
    "text": "and"
  },
  {
    "start": 997.52,
    "end": 998.48,
    "text": "yeah of course"
  },
  {
    "start": 998.64,
    "end": 1000.0,
    "text": "opening the bug"
  },
  {
    "start": 1000.16,
    "end": 1000.72,
    "text": "and uh"
  },
  {
    "start": 1001.04,
    "end": 1003.04,
    "text": "putting some screenshots"
  },
  {
    "start": 1003.28,
    "end": 1003.92,
    "text": "and uh"
  },
  {
    "start": 1004.24,
    "end": 1005.12,
    "text": "describing"
  },
  {
    "start": 1005.28,
    "end": 1006.96,
    "text": "everything that we can"
  },
  {
    "start": 1007.56,
    "end": 1007.8,
    "text": "Uh"
  },
  {
    "start": 1008.04,
    "end": 1011.08,
    "text": "but from the perspective of testing, Chadboat"
  },
  {
    "start": 1011.24,
    "end": 1011.4,
    "text": "is"
  },
  {
    "start": 1011.56,
    "end": 1011.72,
    "text": "uh"
  },
  {
    "start": 1011.88,
    "end": 1012.36,
    "text": "completely"
  },
  {
    "start": 1012.6,
    "end": 1013.16,
    "text": "different"
  },
  {
    "start": 1013.4,
    "end": 1014.04,
    "text": "because uh"
  },
  {
    "start": 1014.28,
    "end": 1015.32,
    "text": "bugs are"
  },
  {
    "start": 1016.36,
    "end": 1019.0,
    "text": "I I would say like invisible."
  },
  {
    "start": 1019.0,
    "end": 1020.12,
    "text": "Why invisible?"
  },
  {
    "start": 1020.12,
    "end": 1022.04,
    "text": "Because they are not in the code."
  },
  {
    "start": 1022.04,
    "end": 1024.76,
    "text": "It can be also the code, of course"
  },
  {
    "start": 1024.9,
    "end": 1025.22,
    "text": "But uh"
  },
  {
    "start": 1025.38,
    "end": 1027.459,
    "text": "sometimes uh bugs in uh like"
  },
  {
    "start": 1027.62,
    "end": 1031.86,
    "text": "in retrieving the information from the database uh"
  },
  {
    "start": 1032.1,
    "end": 1036.18,
    "text": "bugs sometimes can be in uh prompts itself."
  },
  {
    "start": 1036.079,
    "end": 1036.4,
    "text": "because"
  },
  {
    "start": 1036.64,
    "end": 1040.48,
    "text": "uh sometimes we have uh some bad structure of prompt"
  },
  {
    "start": 1040.88,
    "end": 1043.199,
    "text": "but also sometimes we have uh"
  },
  {
    "start": 1043.439,
    "end": 1044.319,
    "text": "bug in in"
  },
  {
    "start": 1044.559,
    "end": 1045.199,
    "text": "generation"
  },
  {
    "start": 1045.36,
    "end": 1046.64,
    "text": "of response."
  },
  {
    "start": 1046.74,
    "end": 1047.3,
    "text": "So it's"
  },
  {
    "start": 1047.459,
    "end": 1047.62,
    "text": "uh"
  },
  {
    "start": 1047.78,
    "end": 1048.02,
    "text": "very"
  },
  {
    "start": 1048.26,
    "end": 1049.14,
    "text": "different uh"
  },
  {
    "start": 1049.3,
    "end": 1049.62,
    "text": "from"
  },
  {
    "start": 1049.78,
    "end": 1051.06,
    "text": "traditional testing."
  },
  {
    "start": 1051.46,
    "end": 1051.54,
    "text": "And"
  },
  {
    "start": 1051.78,
    "end": 1052.66,
    "text": "very very different"
  },
  {
    "start": 1052.82,
    "end": 1054.1,
    "text": "bug types too, you"
  },
  {
    "start": 1054.26,
    "end": 1054.34,
    "text": "you"
  },
  {
    "start": 1054.82,
    "end": 1054.98,
    "text": "find"
  },
  {
    "start": 1055.22,
    "end": 1055.7,
    "text": "okay."
  },
  {
    "start": 1055.7,
    "end": 1056.18,
    "text": "Yeah."
  },
  {
    "start": 1056.18,
    "end": 1056.26,
    "text": "And"
  },
  {
    "start": 1056.42,
    "end": 1057.38,
    "text": "uh but uh w was"
  },
  {
    "start": 1057.54,
    "end": 1057.78,
    "text": "it all"
  },
  {
    "start": 1058.02,
    "end": 1060.1,
    "text": "easy when you when you find something"
  },
  {
    "start": 1060.5,
    "end": 1060.82,
    "text": "maybe"
  },
  {
    "start": 1060.98,
    "end": 1061.22,
    "text": "date"
  },
  {
    "start": 1061.38,
    "end": 1062.9,
    "text": "from the data uh stuff"
  },
  {
    "start": 1063.059,
    "end": 1064.34,
    "text": "or for the training data"
  },
  {
    "start": 1064.5,
    "end": 1065.299,
    "text": "behind that"
  },
  {
    "start": 1065.46,
    "end": 1065.62,
    "text": "uh"
  },
  {
    "start": 1065.78,
    "end": 1065.94,
    "text": "what"
  },
  {
    "start": 1066.1,
    "end": 1068.5,
    "text": "which was which was easy to fix"
  },
  {
    "start": 1068.74,
    "end": 1068.98,
    "text": "uh"
  },
  {
    "start": 1069.299,
    "end": 1069.62,
    "text": "or"
  },
  {
    "start": 1070.76,
    "end": 1076.36,
    "text": "Something uh is easy to fix, but again something is not so easy to fix."
  },
  {
    "start": 1076.679,
    "end": 1077.0,
    "text": "So"
  },
  {
    "start": 1077.32,
    "end": 1078.6,
    "text": "we need to really"
  },
  {
    "start": 1078.919,
    "end": 1079.24,
    "text": "be"
  },
  {
    "start": 1079.399,
    "end": 1080.44,
    "text": "able to log"
  },
  {
    "start": 1080.679,
    "end": 1082.12,
    "text": "everything that we can"
  },
  {
    "start": 1082.46,
    "end": 1082.62,
    "text": "Uh"
  },
  {
    "start": 1082.78,
    "end": 1083.1,
    "text": "so"
  },
  {
    "start": 1083.26,
    "end": 1083.42,
    "text": "uh"
  },
  {
    "start": 1083.66,
    "end": 1085.9,
    "text": "traceability is very important here"
  },
  {
    "start": 1086.14,
    "end": 1090.46,
    "text": "to log uh every information, not just query, not just response."
  },
  {
    "start": 1090.56,
    "end": 1091.28,
    "text": "so to log"
  },
  {
    "start": 1091.44,
    "end": 1091.6,
    "text": "also"
  },
  {
    "start": 1091.84,
    "end": 1093.68,
    "text": "chunks to know why we"
  },
  {
    "start": 1093.92,
    "end": 1094.56,
    "text": "retrieved"
  },
  {
    "start": 1094.88,
    "end": 1095.36,
    "text": "uh some"
  },
  {
    "start": 1095.6,
    "end": 1096.4,
    "text": "chunks, uh"
  },
  {
    "start": 1096.64,
    "end": 1097.92,
    "text": "what was retrieved"
  },
  {
    "start": 1098.16,
    "end": 1098.48,
    "text": "uh"
  },
  {
    "start": 1098.8,
    "end": 1099.04,
    "text": "on"
  },
  {
    "start": 1099.28,
    "end": 1099.52,
    "text": "which"
  },
  {
    "start": 1099.76,
    "end": 1100.08,
    "text": "way"
  },
  {
    "start": 1100.24,
    "end": 1100.4,
    "text": "uh"
  },
  {
    "start": 1100.56,
    "end": 1100.8,
    "text": "so"
  },
  {
    "start": 1100.96,
    "end": 1104.48,
    "text": "everything that we can that can help us in one moment"
  },
  {
    "start": 1105.019,
    "end": 1105.26,
    "text": "To"
  },
  {
    "start": 1105.58,
    "end": 1107.26,
    "text": "fix the bug."
  },
  {
    "start": 1107.26,
    "end": 1111.74,
    "text": "Sometimes we need to retrain our model, to update it, to"
  },
  {
    "start": 1112.22,
    "end": 1113.899,
    "text": "start to figure out about"
  },
  {
    "start": 1114.22,
    "end": 1115.5,
    "text": "some strategies"
  },
  {
    "start": 1115.82,
    "end": 1116.139,
    "text": "to"
  },
  {
    "start": 1116.38,
    "end": 1117.34,
    "text": "handle all"
  },
  {
    "start": 1117.5,
    "end": 1119.34,
    "text": "those situations."
  },
  {
    "start": 1119.54,
    "end": 1119.7,
    "text": "uh"
  },
  {
    "start": 1119.94,
    "end": 1120.58,
    "text": "but also"
  },
  {
    "start": 1120.82,
    "end": 1121.06,
    "text": "yeah"
  },
  {
    "start": 1121.3,
    "end": 1122.74,
    "text": "error can happen"
  },
  {
    "start": 1123.38,
    "end": 1123.54,
    "text": "uh"
  },
  {
    "start": 1123.86,
    "end": 1124.18,
    "text": "and"
  },
  {
    "start": 1124.34,
    "end": 1124.66,
    "text": "uh"
  },
  {
    "start": 1124.9,
    "end": 1125.54,
    "text": "we need"
  },
  {
    "start": 1125.7,
    "end": 1126.34,
    "text": "also to"
  },
  {
    "start": 1126.5,
    "end": 1127.7,
    "text": "have that in mind"
  },
  {
    "start": 1127.94,
    "end": 1128.98,
    "text": "that uh if we"
  },
  {
    "start": 1129.3,
    "end": 1131.54,
    "text": "doing everything to prevent it"
  },
  {
    "start": 1131.72,
    "end": 1133.24,
    "text": "and it is happening"
  },
  {
    "start": 1133.4,
    "end": 1133.64,
    "text": "that"
  },
  {
    "start": 1133.8,
    "end": 1135.56,
    "text": "we can accept it"
  },
  {
    "start": 1135.88,
    "end": 1136.04,
    "text": "uh"
  },
  {
    "start": 1136.28,
    "end": 1136.6,
    "text": "and"
  },
  {
    "start": 1136.92,
    "end": 1137.24,
    "text": "to"
  },
  {
    "start": 1137.4,
    "end": 1137.56,
    "text": "uh"
  },
  {
    "start": 1137.72,
    "end": 1139.64,
    "text": "have some lessons from there"
  },
  {
    "start": 1140.04,
    "end": 1140.28,
    "text": "uh"
  },
  {
    "start": 1140.52,
    "end": 1143.96,
    "text": "to maybe implement some uh fallback logic"
  },
  {
    "start": 1144.12,
    "end": 1144.44,
    "text": "uh"
  },
  {
    "start": 1144.92,
    "end": 1145.24,
    "text": "um"
  },
  {
    "start": 1146.12,
    "end": 1147.56,
    "text": "for our chat boat."
  },
  {
    "start": 1147.8,
    "end": 1148.2,
    "text": "Also"
  },
  {
    "start": 1148.36,
    "end": 1152.68,
    "text": "maybe to implement some additional logic for questioning"
  },
  {
    "start": 1152.84,
    "end": 1153.32,
    "text": "like uh"
  },
  {
    "start": 1153.48,
    "end": 1154.52,
    "text": "to chat boat"
  },
  {
    "start": 1154.68,
    "end": 1155.96,
    "text": "be able to uh"
  },
  {
    "start": 1156.12,
    "end": 1157.56,
    "text": "ask a user"
  },
  {
    "start": 1157.94,
    "end": 1160.419,
    "text": "Are you thinking about this or that?"
  },
  {
    "start": 1160.419,
    "end": 1160.5,
    "text": "Uh"
  },
  {
    "start": 1160.82,
    "end": 1161.139,
    "text": "to"
  },
  {
    "start": 1161.38,
    "end": 1162.34,
    "text": "ask for"
  },
  {
    "start": 1162.58,
    "end": 1162.899,
    "text": "uh"
  },
  {
    "start": 1163.46,
    "end": 1163.779,
    "text": "more"
  },
  {
    "start": 1163.94,
    "end": 1164.98,
    "text": "explanation"
  },
  {
    "start": 1165.22,
    "end": 1166.019,
    "text": "what we are"
  },
  {
    "start": 1166.519,
    "end": 1168.039,
    "text": "asking about."
  },
  {
    "start": 1168.6,
    "end": 1169.159,
    "text": "Also"
  },
  {
    "start": 1169.32,
    "end": 1169.639,
    "text": "yeah"
  },
  {
    "start": 1169.88,
    "end": 1170.2,
    "text": "to"
  },
  {
    "start": 1170.76,
    "end": 1171.72,
    "text": "try to"
  },
  {
    "start": 1172.6,
    "end": 1172.919,
    "text": "use"
  },
  {
    "start": 1173.159,
    "end": 1175.96,
    "text": "all feedback that we have from user"
  },
  {
    "start": 1176.34,
    "end": 1176.5,
    "text": "uh"
  },
  {
    "start": 1176.74,
    "end": 1180.66,
    "text": "all errors to retrain our model to make it better."
  },
  {
    "start": 1181.299,
    "end": 1181.62,
    "text": "But"
  },
  {
    "start": 1181.78,
    "end": 1184.5,
    "text": "yeah it's it's normal to have some errors"
  },
  {
    "start": 1184.74,
    "end": 1185.46,
    "text": "in the end."
  },
  {
    "start": 1185.539,
    "end": 1186.1,
    "text": "Yeah sure."
  },
  {
    "start": 1186.1,
    "end": 1187.299,
    "text": "That's that's that's I think that's"
  },
  {
    "start": 1187.78,
    "end": 1188.82,
    "text": "a part why we test"
  },
  {
    "start": 1189.059,
    "end": 1189.299,
    "text": "so"
  },
  {
    "start": 1189.62,
    "end": 1189.94,
    "text": "uh"
  },
  {
    "start": 1190.16,
    "end": 1191.12,
    "text": "Uh when we come to"
  },
  {
    "start": 1191.6,
    "end": 1194.56,
    "text": "test documentation, did you use the same tools for uh"
  },
  {
    "start": 1194.8,
    "end": 1194.96,
    "text": "as"
  },
  {
    "start": 1195.12,
    "end": 1195.2,
    "text": "you"
  },
  {
    "start": 1195.36,
    "end": 1195.44,
    "text": "use"
  },
  {
    "start": 1195.76,
    "end": 1195.84,
    "text": "for"
  },
  {
    "start": 1196.72,
    "end": 1197.04,
    "text": "uh"
  },
  {
    "start": 1197.76,
    "end": 1200.559,
    "text": "writing your test cases and stuff uh like a Jira"
  },
  {
    "start": 1200.96,
    "end": 1202.32,
    "text": "or something or an Excel"
  },
  {
    "start": 1202.48,
    "end": 1204.799,
    "text": "spreadsheet or another test management tool?"
  },
  {
    "start": 1204.799,
    "end": 1205.28,
    "text": "Or do you"
  },
  {
    "start": 1205.44,
    "end": 1207.52,
    "text": "did you use different tools for"
  },
  {
    "start": 1208.179,
    "end": 1209.779,
    "text": "Managing your test cases and"
  },
  {
    "start": 1210.26,
    "end": 1210.5,
    "text": "um"
  },
  {
    "start": 1210.899,
    "end": 1215.86,
    "text": "so most of the tools that we have now, test management tools, has some"
  },
  {
    "start": 1216.34,
    "end": 1216.659,
    "text": "uh"
  },
  {
    "start": 1217.54,
    "end": 1217.62,
    "text": "uh"
  },
  {
    "start": 1217.94,
    "end": 1218.58,
    "text": "built"
  },
  {
    "start": 1218.82,
    "end": 1219.46,
    "text": "AI"
  },
  {
    "start": 1219.62,
    "end": 1219.86,
    "text": "like"
  },
  {
    "start": 1220.1,
    "end": 1221.14,
    "text": "some add-in"
  },
  {
    "start": 1221.38,
    "end": 1221.7,
    "text": "or"
  },
  {
    "start": 1221.94,
    "end": 1222.26,
    "text": "uh"
  },
  {
    "start": 1222.5,
    "end": 1223.62,
    "text": "in itself uh"
  },
  {
    "start": 1223.78,
    "end": 1224.82,
    "text": "so basically"
  },
  {
    "start": 1224.98,
    "end": 1226.34,
    "text": "we can use it."
  },
  {
    "start": 1227.159,
    "end": 1227.48,
    "text": "But"
  },
  {
    "start": 1228.12,
    "end": 1228.44,
    "text": "also"
  },
  {
    "start": 1229.0,
    "end": 1229.32,
    "text": "we"
  },
  {
    "start": 1229.88,
    "end": 1231.24,
    "text": "tried to automate"
  },
  {
    "start": 1231.399,
    "end": 1231.639,
    "text": "though"
  },
  {
    "start": 1231.799,
    "end": 1234.6,
    "text": "that process, a particular process, so"
  },
  {
    "start": 1234.919,
    "end": 1236.84,
    "text": "to make it easier."
  },
  {
    "start": 1238.22,
    "end": 1238.38,
    "text": "uh"
  },
  {
    "start": 1238.54,
    "end": 1239.98,
    "text": "to to type everything"
  },
  {
    "start": 1240.22,
    "end": 1243.26,
    "text": "because it's very hard and uh time consuming."
  },
  {
    "start": 1243.66,
    "end": 1244.86,
    "text": "Yeah, yeah, that's true."
  },
  {
    "start": 1244.86,
    "end": 1245.02,
    "text": "Uh"
  },
  {
    "start": 1245.18,
    "end": 1245.26,
    "text": "and"
  },
  {
    "start": 1245.5,
    "end": 1246.3,
    "text": "do you have um"
  },
  {
    "start": 1246.62,
    "end": 1247.26,
    "text": "in the process"
  },
  {
    "start": 1247.42,
    "end": 1248.22,
    "text": "where or where in your"
  },
  {
    "start": 1248.38,
    "end": 1248.54,
    "text": "now"
  },
  {
    "start": 1248.7,
    "end": 1248.78,
    "text": "with"
  },
  {
    "start": 1248.94,
    "end": 1249.02,
    "text": "with"
  },
  {
    "start": 1249.18,
    "end": 1250.7,
    "text": "uh a a lot of experience about"
  },
  {
    "start": 1250.86,
    "end": 1252.38,
    "text": "the chatbot testing"
  },
  {
    "start": 1252.34,
    "end": 1255.299,
    "text": "Is there a tool that you missed all the time"
  },
  {
    "start": 1255.46,
    "end": 1256.1,
    "text": "where you said"
  },
  {
    "start": 1256.26,
    "end": 1260.9,
    "text": "that would be great if there would be a tool that helps me with this problem?"
  },
  {
    "start": 1261.2,
    "end": 1261.84,
    "text": "Yeah, some"
  },
  {
    "start": 1262.0,
    "end": 1263.12,
    "text": "magic tool."
  },
  {
    "start": 1263.12,
    "end": 1264.24,
    "text": "I didn't find it"
  },
  {
    "start": 1264.48,
    "end": 1265.68,
    "text": "actually."
  },
  {
    "start": 1265.68,
    "end": 1266.0,
    "text": "That"
  },
  {
    "start": 1266.32,
    "end": 1269.2,
    "text": "is doing everything instead of me."
  },
  {
    "start": 1269.2,
    "end": 1275.76,
    "text": "Yeah, I'm joking a bit, but uh yes, I I think uh we are missing tools still."
  },
  {
    "start": 1275.64,
    "end": 1275.8,
    "text": "uh"
  },
  {
    "start": 1275.96,
    "end": 1276.12,
    "text": "good"
  },
  {
    "start": 1276.28,
    "end": 1278.6,
    "text": "tools that are doing the stuff."
  },
  {
    "start": 1278.6,
    "end": 1278.92,
    "text": "Like"
  },
  {
    "start": 1279.16,
    "end": 1279.48,
    "text": "here"
  },
  {
    "start": 1279.88,
    "end": 1280.2,
    "text": "we"
  },
  {
    "start": 1280.52,
    "end": 1281.48,
    "text": "used a lot of"
  },
  {
    "start": 1281.64,
    "end": 1283.32,
    "text": "different tools to try it"
  },
  {
    "start": 1283.72,
    "end": 1285.0,
    "text": "and one of the"
  },
  {
    "start": 1285.8,
    "end": 1286.12,
    "text": "most"
  },
  {
    "start": 1286.6,
    "end": 1287.96,
    "text": "successful tools"
  },
  {
    "start": 1289.52,
    "end": 1290.88,
    "text": "was uh ragas"
  },
  {
    "start": 1291.2,
    "end": 1292.4,
    "text": "uh for testing rags"
  },
  {
    "start": 1292.64,
    "end": 1293.28,
    "text": "systems uh"
  },
  {
    "start": 1293.44,
    "end": 1295.52,
    "text": "but uh I think uh that we"
  },
  {
    "start": 1295.84,
    "end": 1296.0,
    "text": "uh"
  },
  {
    "start": 1296.16,
    "end": 1297.92,
    "text": "cannot test everything like"
  },
  {
    "start": 1298.08,
    "end": 1298.8,
    "text": "with it."
  },
  {
    "start": 1299.519,
    "end": 1299.679,
    "text": "just"
  },
  {
    "start": 1299.919,
    "end": 1300.48,
    "text": "one part"
  },
  {
    "start": 1300.72,
    "end": 1302.88,
    "text": "then a lot of manual testing"
  },
  {
    "start": 1303.2,
    "end": 1303.84,
    "text": "again"
  },
  {
    "start": 1304.08,
    "end": 1304.72,
    "text": "and uh"
  },
  {
    "start": 1304.96,
    "end": 1308.72,
    "text": "I think it's not just in in the chatbot testing uh"
  },
  {
    "start": 1308.96,
    "end": 1309.76,
    "text": "In majority"
  },
  {
    "start": 1309.92,
    "end": 1311.28,
    "text": "things we can use"
  },
  {
    "start": 1311.52,
    "end": 1314.24,
    "text": "AI in some parts, but in some"
  },
  {
    "start": 1314.56,
    "end": 1315.04,
    "text": "where is"
  },
  {
    "start": 1315.36,
    "end": 1317.12,
    "text": "hard infrastructure"
  },
  {
    "start": 1317.28,
    "end": 1317.6,
    "text": "like"
  },
  {
    "start": 1317.76,
    "end": 1318.96,
    "text": "subsystems"
  },
  {
    "start": 1319.28,
    "end": 1321.12,
    "text": "or something like that."
  },
  {
    "start": 1321.3,
    "end": 1323.62,
    "text": "Maybe it will change during the"
  },
  {
    "start": 1323.94,
    "end": 1325.7,
    "text": "next period, but"
  },
  {
    "start": 1325.86,
    "end": 1326.5,
    "text": "for now"
  },
  {
    "start": 1326.9,
    "end": 1327.22,
    "text": "we"
  },
  {
    "start": 1327.38,
    "end": 1327.86,
    "text": "we miss"
  },
  {
    "start": 1328.1,
    "end": 1328.42,
    "text": "some"
  },
  {
    "start": 1328.58,
    "end": 1329.06,
    "text": "tools."
  },
  {
    "start": 1330.019,
    "end": 1330.98,
    "text": "And may maybe it's it's"
  },
  {
    "start": 1331.22,
    "end": 1331.779,
    "text": "because it's uh"
  },
  {
    "start": 1332.019,
    "end": 1332.179,
    "text": "I think"
  },
  {
    "start": 1332.419,
    "end": 1334.82,
    "text": "a very very new topic to test this stuff."
  },
  {
    "start": 1334.82,
    "end": 1335.7,
    "text": "They are just"
  },
  {
    "start": 1335.94,
    "end": 1338.5,
    "text": "individual customized solutions"
  },
  {
    "start": 1338.659,
    "end": 1340.5,
    "text": "and then they will sometime"
  },
  {
    "start": 1340.659,
    "end": 1342.419,
    "text": "get uh become a product"
  },
  {
    "start": 1342.58,
    "end": 1342.899,
    "text": "uh"
  },
  {
    "start": 1343.06,
    "end": 1344.02,
    "text": "and and a suite"
  },
  {
    "start": 1344.18,
    "end": 1349.38,
    "text": "for testing maybe a chatboard or something like that to combine these tools, but that's m maybe the"
  },
  {
    "start": 1349.54,
    "end": 1350.18,
    "text": "the future."
  },
  {
    "start": 1350.18,
    "end": 1350.82,
    "text": "Yeah"
  },
  {
    "start": 1352.98,
    "end": 1354.34,
    "text": "Yeah Dusanka"
  },
  {
    "start": 1354.5,
    "end": 1356.74,
    "text": "thank you very much for this insights."
  },
  {
    "start": 1356.74,
    "end": 1357.22,
    "text": "Uh uh"
  },
  {
    "start": 1357.38,
    "end": 1357.94,
    "text": "I think just"
  },
  {
    "start": 1358.48,
    "end": 1359.04,
    "text": "Testing is"
  },
  {
    "start": 1359.2,
    "end": 1361.84,
    "text": "a thing I I want to try it out someday."
  },
  {
    "start": 1361.84,
    "end": 1364.24,
    "text": "Yes, I encourage you to try it."
  },
  {
    "start": 1364.72,
    "end": 1365.6,
    "text": "Just to play"
  },
  {
    "start": 1366.0,
    "end": 1367.04,
    "text": "around with it"
  },
  {
    "start": 1367.36,
    "end": 1369.68,
    "text": "and to see what is happening, to"
  },
  {
    "start": 1369.84,
    "end": 1370.0,
    "text": "uh"
  },
  {
    "start": 1370.16,
    "end": 1372.16,
    "text": "try to to learn"
  },
  {
    "start": 1372.12,
    "end": 1372.28,
    "text": "Uh"
  },
  {
    "start": 1372.52,
    "end": 1372.76,
    "text": "from"
  },
  {
    "start": 1373.0,
    "end": 1373.16,
    "text": "it"
  },
  {
    "start": 1373.4,
    "end": 1374.04,
    "text": "but also"
  },
  {
    "start": 1374.28,
    "end": 1374.52,
    "text": "uh"
  },
  {
    "start": 1374.68,
    "end": 1379.48,
    "text": "to try to train it a bit uh with questions and everything, I think"
  },
  {
    "start": 1379.74,
    "end": 1381.66,
    "text": "It's very useful and interesting."
  },
  {
    "start": 1381.66,
    "end": 1381.98,
    "text": "Yeah."
  },
  {
    "start": 1382.3,
    "end": 1383.1,
    "text": "So thank you on"
  },
  {
    "start": 1383.26,
    "end": 1384.7,
    "text": "this invitation also."
  },
  {
    "start": 1384.7,
    "end": 1388.06,
    "text": "Yeah, thank you for your time and enjoy the rest of the conference and then"
  },
  {
    "start": 1388.22,
    "end": 1388.54,
    "text": "uh"
  },
  {
    "start": 1388.56,
    "end": 1389.68,
    "text": "Safe travel home."
  },
  {
    "start": 1390.24,
    "end": 1392.88,
    "text": "And to the next conference, I know you're going to a"
  },
  {
    "start": 1393.2,
    "end": 1393.6,
    "text": "Yes."
  },
  {
    "start": 1393.76,
    "end": 1396.08,
    "text": "Next conference is expected to me"
  },
  {
    "start": 1396.34,
    "end": 1399.7,
    "text": "And uh yeah, thank you on this invitation and uh also"
  },
  {
    "start": 1399.94,
    "end": 1402.02,
    "text": "enjoy in the rest of the conference."
  },
  {
    "start": 1402.02,
    "end": 1402.179,
    "text": "Thank you"
  },
  {
    "start": 1402.5,
    "end": 1403.46,
    "text": "very much."
  }
]