Testim

Avantages

What I like most about Testim is the user interface. This from a developer who is used to hacking around in code. The user interface provided for both recording, creating and editing/maintaining tests is a pleasure to use. It offers a no-code approach to testing, but one that allows a test developer to dive into code when necessary.

The way our test team works is we have two non-coders, one did some code 20 years ago, can manage a bit of javascript to myself a technical developer who deals with anything technical that might come up. Usually writing a shared custom action or shared step to perform a particularly tricky bit of testing, that the non-coders can then use in their test.

I would say 95% of our test development is developed without code because of Testim.

Inconvénients

I have yet to find anything that I would consider as disliking. If something isn't working as expected its usually because I am doing something wrong.

Avantages

Testim did great job investigating and addressing all famous automation pain points.
First, they take care of all the "side work" (environments, code libraries, setups, versions, etc.) allowing companies to fully concentrate on increasing testing coverage of their business flows.
Second, being stable, reliable and intuitive solution, it allows achieving impressive outcome quite fast. Following best practices, it is quite easy to build very scalable automation project. There was nothing I couldn't achieve with Testim using it for almost a year by now.
Next, the Smart Locators mechanism proves itself de-facto: UI changes but tests keeps running identifying the elements by alternative identifiers.
Last but not least, reporting tools are highly self explanatory allowing developers to easily analyze failures and release QA bottle neck.

To summarize, Testim.io is quite a robust tool allowing to establish and maintain effective automation using both codeless and coded techniques. It is important to understand, that technical background is required to achieve success in automation project. Record&Play is a great start, however in order to be scalable, following the concepts of programming basics (such as reusable components, parameters, loops and conditions) is essential in order to be able to always extend the coverage rather than spending time on tests' maintenance upon application changes.
Having the availability (and passion 🙂) is all you need in order to succeed with Testim.

Inconvénients

There are always things to improve to any software and I have a list of my "nice to have" enhancement requests which is being addressed in our Product-Customers channel. None of them is a showstopper.

Avantages

Easily usable and can be used by anyone.

Inconvénients

It doesnt look customizable. Suppose I need to add certain if else or loops to it, i cant find a way to do so

Avantages

Ease of use, the ability to add almost any validation or action you can think with code integration.

Inconvénients

Pricing model is very weird when you start using the product. It's very hard to define how many tests you run if you don't know how to define a single test in a new system you are unfamiliar with.

Avantages

- Easy of use
- Various great features such as: Branches/Parallel tests/Scheduler runner/API Actions/Email/Custom JavaScript Editor and many more
- Amazing customer & technical support

Inconvénients

- Can't copy steps from one project to another
- Lack of a mobile automation

Avantages

1. It is super easy (and insanely fast) to record tests with little to no technical knowledge.
2. Where technical knowledge is needed, there are a lot of resources and guidance for me to use. The support team on Live Chat has been phenomenal, and they were available at like 11 PM at night.
3. If a test breaks for whatever reason (e.g. construction was done on the page so an element got removed), it's actually not that hard to re-record the test. You can keep whatever steps were working, delete the steps that don't work, and re-record from there.

Inconvénients

This is just a wishlist of things I want:

1. The ability to run mobile tests on Safari, Firefox, and Edge
2. A predefined step for validating the comparison of two things (e.g. Text A is numerical and is greater than or equal to the number in Text B)
3. A predefined step of validating a whole div instead of a single element
4. The ability to run tests across multiple browsers without using CL

Alternatives envisagées 

Pourquoi passer à Testim

Avantages

Easy and fast to set up simple automated test cases

Inconvénients

A little bit difficult to navigate the system in the beginning

Avantages

With Testim, our time from development to Production has decreased to minutes.

It allows us to test new features in no time with full regression test coverage & CI integration.

Test stability is very high, the results are easy to read and diagnose.

Inconvénients

we still have some difficult with image verification (on dynamic map).

Avantages

Powerful tests which requires no code
Big variety of functionalities
Intuitive

Inconvénients

Could slow down merges if you dont run in parallel

Avantages

Tests and locators are stable
Quick authoring
complete infrastructure including run servers, email, reports, scheduling etc.
Amazing support team

Inconvénients

Integration with Azure devops pipeline should be very easy but for some reason it's not working for us yet. still trying to figure this one out.

Avantages

The product has excellent documentation which guides you through the onboarding process, in addition the sample project and examples are incredibly helpful. The learning curve was short from start to having a series of tests running and finding bugs was within days and using Testim has helped me get fresh insights in to how our product works. Having predefined test steps is a huge help and shared steps makes reusability a snap. Reusability at cross-environment level is also made easy by Testim projects working with branches: we now have branches of test suites for our Dev, Staging and Production. The next step for us is to add our tests suites to the CI/CD pipeline in Azure Devops which also appears to be well documented and intuitive to enable.

Inconvénients

the two major features missing for our needs are integration with Azure Devops at test-case level and copy tests between projects. However, Testim were responsive to the request for integration with ADO and are working with us on this.

Avantages

Accurately and easily record steps, allows JS execution, re-use of steps and groups of steps, has example practical tutorials readily available, CLI and CI support, has a JavaScript syntax and auto-complete editor, incognito run mode. All test changes and runs are tracked git-style, videos of test runs can be recorded and bugs can be created from the test runs. Baseline screenshots can be compared to see what changed/caused a failure, console logs and network logs available on failure. Warnings and errors are picked up during run, helping trace untracked bugs/errors.

Inconvénients

UX for navigating on the platform is confusing. The screen resolutions are limited to 1080p (if you're building your tests on your machine, they might differ when you run them on the test grid since scaling is not customizable). Does not support tablet testing natively. Some really fine-tuning things like dragging and dropping on specific areas of UI don't always work as recorded. The JS editor doesn't know about variables from other steps or from the test data (forces user to go out of the specific step and go search). Reporting is very minimal.

Avantages

Grouping, Parameterization, Dynamic Locators, Branching and merging, Validation and Assertions, CLI, Test results Screenshots and Labeling test script.
I have used each and every of the above features in all my scripts and it is very easy to implement for any project.

Inconvénients

I can only Schedule Run process for any of my scripts only by hour in GMT time zone. It would be nice to schedule run any of my scripts by hour and minutes. During prod deployment if our deployment gets completed lets say around 8:10 am/pm then I have to wait until next hour (i.e. 9:00 am/pm) to run my schedule run process. Also, when any script fails during field validation check. Instead of simply displaying the entire Expected vs Actual results. I would like to see only difference between the two results.

Avantages

the no/low code, AI driven test creation combined with template test steps, shared (reusable) steps and custom steps (Javascript) make Testim an automated testing solution for testers of all levels of ability. Using the recorder via the browser extension means a tester can record an exploratory session and show active generation / capture of defects by sharing the saves test run with their Dev

Inconvénients

1. Mobile responsive testing is supported but only on simulated devices. I would like to be able to connect to live devices thru services like Browserstack.
2. Testim has support for API actions or validations as steps, I would like to import a collection to generate happy path tests for each call or use the recorder to capture each call thru the UI

Avantages

Automating web apps with a fast start up and little training was the draw for my team. We were able to onboard others that normally would not automate tests to assist us once trained on Testim and our standards. Everyone was excited about the use of Testim with our API integrations for the UI, and the flexibility of using variables and shared steps make an important part of our automation tool set.

Inconvénients

The step comments are on the far right and we would like to see them as hover tips. Drag and drop could be included. Once a test fails in the grid, no email alerts are provided until the suite passes again. Scrolling in the app under test has to be worked around.

Avantages

Testim is extremely accessible for those who are non-technical as tests can be authored without writing a single line of code. Testim also has the flexibility for those who are familiar with code to author personal enhancements to the existing Testim functionality. Customer support is always active and addresses any issues very quickly.

Inconvénients

The learning curve for using the software can be both simple and steep. It is simple in the fact that users can simply record their actions and have Testim replay them. It can be complex implementing some of the deeper functionality Testim offers such as grouping test steps, using dynamic test parameters, and dynamic data sets for reusability.

Avantages

It is very easy to understand. New trainee and people can easly understand it after one time guidance. Do the things in very less time which helps us to makes our productions more faster as well as its customer support is also very good.

Inconvénients

As if now we have faced issues with some dynamic testing things else everything is fine with testim as it is a good tool for automation testing for technical and as well as for non technical person

Avantages

I like the easy of use and the fact it does what it say it does - test UI

Inconvénients

The system failling alot and not always working good

Avantages

We find that the available continuous integration support has been quite helpful.

Inconvénients

The "self-learning" aspect doesn't seem to do quite as much as what I was thinking/expecting it might do, but overall the tool has still been quite beneficial for us.

Avantages

it is very easy automation testing tool. Which require no code but gives the best and variety of functionality.it is extremely easy who are non technical. Users can easily record their action and send directly via emails.

Inconvénients

Overall it is good tool but seems it doesn’t work on Firefox.

Avantages

I could record and run a test within 15 minutes of getting into the tool.

Inconvénients

The grids are complicated, and we had a hard time learning more with the resources available.

Avantages

The software runs very reliably and stable. Overall its very easy to use, and I was even able to teach non-technical people to use the system, and write their own test cases.

Inconvénients

Unfortunately, it does not work in Firefox that well.

Avantages

Mostly simple to use but when it's not, support is quick and very helpful.

Inconvénients

Sometimes tests fail for unknowns reasons and the pass upon subsequent executions. So the product is mostly stable but slightly unreliable at times.

Avantages

I like almost everything while trying out Testim that popped up in my search result when I find for web crawling script generator. I personally like using Testim a lot because it can generate codes as you are performing specific actions on a website. It converts into Javascript! That was very cool to see what testim can achieve.

Inconvénients

The least thing that I like about Testim is that you have to generate JavaScript codes from the Testim Playground. I hope that they could make it part of the main website function.

Avantages

Its very simple and quick tool to start automating the product

Inconvénients

Did not find something about it. Was very good experience