search

codeforequity-at / botium-core

The Selenium for Chatbots - Bots Testing Bots
https://www.botium.ai
MIT License
230 stars 64 forks source link

Botium box - test results #398

Closed nk009 closed 4 years ago

nk009 commented 5 years ago

I am not getting any results after starting test (0 jobs running, 0 jobs failed). I just started using Botium box, so I cannot guarantee that everything is setup correctly or If anything has been missed to be setup.

1, go to quickstart 2, select created chatbot 3, select test set 4, select device set 5, click on "Save and start testing"

On the attached screenshot you can see the results:

Capture

id: "ck1al1m0600va0871avqdmvvb"

2019-10-03T10:51:47.220Z: Job queued for execution 2019-10-03T10:51:48.726Z: Job completed

2019-10-03T10:51:47.302Z: Job queued for execution 2019-10-03T10:51:50.113Z: Job completed

Below is a Botium version:

Build Target: basic Build Branch: release/1.7.5 Build Revision: 2aedecaec6ded8bcb689ba8e4db67f7374467ffb Build Date: 2019-09-06T19:59:48+02:00 Licensed Edition: community License Validity: no restrictions License Operability: no restrictions

codeforequity-at commented 5 years ago

What test set and what chatbot are you using ?

nk009 commented 5 years ago

Do you need details, how is the Test set I am using, setup?

I am using a ChatBot where is necessary to click on a button to start a conversation. Which leads me to question, If Botium supports this possibility? Or If it is only for Chatbots with already opened conversation.

I attached a screenshot how I setup the Chatbot

Capture
codeforequity-at commented 5 years ago

Well, in theory, this is supported, but E2E Testing is the hardest way to start, as it requires at least writing Selenium selectors, and nearly everytime involves writing some Webdriver javascript code - you can read about it here: https://github.com/codeforequity-at/botium-connector-webdriverio

Typically, you start testing with Botium on API level and connect to the Chatbot backend to exchange messages.

Furthermore, I think your test set has some flaws, as Botium didn't recognize any test cases. This repository has a webdriver sample for Botium Box, please check if this is working for you.

nk009 commented 5 years ago

hi all,

would anyone here be able to send me some examples what you are using here, see screenshot below

Capture

I am not sure If these elements are correctly insterted

nk009 commented 5 years ago

hi all,

would anyone here be able to send me some examples what you are using here, see screenshot below

Capture

I am not sure If these elements are correctly insterted

codeforequity-at commented 5 years ago

it looks reasonable, but without knowing anything about structure of the DOM tree it is impossible to say if the selectors are correct.

Let me point you to a repository with some Botium samples: https://github.com/codeforequity-at/botium-box-samples

There you can find some examples for the botium webdriver connector as well (using PhantomJS)

codeforequity-at commented 4 years ago

Please re-open if new data available.