Katalon Studio

Avantages

Katalon studio est un outil excellent.Il s'integre avec tout presque, il importe des tests case depuis Selenium, depuis open api v2 ou v3.

Inconvénients

On a commencé à l'adapter, mais le changement de politique de licence était trop agressive.On a eu besoin de changer l'activation offline par une online : Le support a refusé, il fallait attendre un mois pour faire ce type de changement

Avantages

I can use my Selenium and Java experiences. Learning is very easy. You can do anything you need for automation including GUI, API, Mobile in one tool. Very productive for Automation.

Inconvénients

Having difficulties to integrate with AWS Device Farm

Avantages

It's very easy to use, interface is clean and simple, providing exactly what's needed for the end user, despite simple web or even a more complex API testing as well.

Inconvénients

It's a bit heavy, having some performance issues during some intense usage. Exporting automation scripts provides decent, but results could be a bit more improved.

Avantages

Wow,

1. Free evaluation licensing,
2. ROI on investment
3. Object repository capaibilities like QTP, totally missing in selenium
4. Frameworks seem to be there, all qa models in software testing have frameworks, you will also get there soon.

Inconvénients

Cons:
Sorry to say, no market in 50BN US $ Software automation market in 2017 AD.

2. Nobody is giving any certification in Selenium unlike QTP, yet top R&D countries like USA, India, UK, Australia, Israel, Canda, and Japan maybe will go after selenium

3. If a software SDET, QA DEv or automation engineer is looking for an SAP type career it has ended, QTP is no more. For mobile markets open source is pathetic with Appium. Katalon need to be cheap, better than QTP, Selenium and Ranorex, other competitors i think

4. I am a corporate trainer, in Selenium, Manual Testing, SoapUI, Database and Appium. I dont recommend Katalon Studio for freshers unless they are lucky the company is sponsoring training.

5. All IT institutes in India, train in selenium as a testing tool, RPA tools Blue Prism, Uipath etc. How will katalon change its market strategy. Sorry for the bad news.

Avantages

Katalon Studio is an affordable solution that allows for many complex testing needs to be met and integrated within the QA pipeline. We used Katalon as a testing agent for our API developments and ongoing monitoring for Single Sign On solutions. Setup was quick and easy with more in depth functionality as we saw fit available to fine tune our testing and monitoring.

Inconvénients

There was a small learning curve in the language used to develop the scripts but nothing major. The biggest hit came when they moved from allowing us to call Katalon via a batch script for free and making you pay for individual engines to run to allow for our monitoring.

Avantages

The tool can be used to test the following:
1) API
2) Web Applications
3) Mobile applications

Requires minimal programming knowledge to leverage the tool for application testing.

Easily integrated with 3rd party applications like Slack.

Ready, Handy and FREE plugins available to make testing more effective.

Test scripts are interchangeable with Selenium Webdriver.

Inconvénients

Since this tool is somewhat new in the market compared to Selenium Webdriver, hence, its at times difficult to find solutions if a user is stuck in a problem. However, the KS developers tries their level best to find the suitable solution for you as early as possible.

Avantages

The best about Katalon is that test cases can be created easily using the visual interface (katalon recorder), but can later be made more powerful using the scripting tools. It's also great to be able to export them and reimport them easily, allowing our team to collaborate adding new test cases with each passing version. We haven't yet integrated katalon with Jenkins, but knowing that its possible is great for us.

Inconvénients

It took a bit of learning at first, since we used other tools before, but once that was done it's relatively easy to use. The community of users is not that large, but its apparently greowing since users from selenyum are mostly migrating to katalon. We've had some performance issues with it, and some cross browser differences, however, this didn't happen often.

Avantages

Easy to use and merge all needs automated testing in one environment.

Inconvénients

its to heavy. i hope it will more light and more faster when run start at first time

Avantages

Recorder and Playback for beginners, Keyword Driven for intermediates, or Java/Selenium Webdriver for advanced usage.
Direct Integration with Git, Jira, Browserstack, Docker, Kobiton, Jenkins, and a console mode allowing Integration with Azure Build pipelines, or anything supporting command line execution.
Supports Page Object Model, full Java , Groovy, and Selenium Webdriver syntax directly
Based on Eclipse IDE which some will find familiar.
Cucumber support for BDD /ATDD
Extendable with external with java package imports
API testing facility rivalling Postman built in
Fully documented features
Developers listen to the community

Inconvénients

Growing community, but still in its infancy
Analytics tool but still in Beta
Support for many integrations, but requires a lot of research to get these working properly
Lack of support for .NET languages (although hardly a compromise)

Avantages

I liked how intuitive and easy is the tool in helping the Quality Team to record and play their Test Automation Scripts without having programming knowledge. Also the tool provides many other features including Web Applications Testing, API Testing, Mobile Testing, Desktop Applications Testing, etc.

Inconvénients

The tool can be a little expensive. Also, since the tool is relatively new to the market compared to some other tools, this makes troubleshooting an issue a bit difficult as you won't find large support community.

Avantages

- Availability of tutorials
- Ability to design Test Cases using Editor with the pre-defined set of commands
- Comfortable UI for Dev & QA team (it has Eclipse-like interface)
- It is a feature-rich solution to address most of the tasks
- Ability to use the tool for Web UI tests, REST API tests and mobile testing

Inconvénients

- Reporting for BDD tests should be improved. It should display more meaningful information about the steps performed in a readable way (BDD test looks actually more meaningful than a report - that is weird).

Avantages

this app is very easy to use with tool od developed and you will make automation frameworks in an easy way

Inconvénients

this app is very simple to use to develop your tools and make structured framework

Avantages

Katalon is easily one of the best open source software tools for GUI automation testing. Its intuitive interface requires a minimal learning curve and with the official documentation online, someone with zero testing/coding experience can write a comprehensive test. Test suites and collections allow enterprise level testing by allowing users to run numerous tests in series or parallel in different browser configurations.

If you have some experience as a programmer, Katalon's modularity allows it to be extremely flexible. Programmers can write robust keywords (functions) and classes, that can extend testing functionality. The Cucumber integration makes it easy to write BDD tests. Katalon also allows you to import .jar files to extend functionality making the program even more robust.

Katalon also runs its tests quickly and provides users to run tests through command line allowing for Jenkins integration which is necessary for enterprise level testing.

Inconvénients

Katalon is an excellent software, but it is not without its bugs. For convenience I will list them:

- Biggest issue is documentation. There is some great official documentation for Katalon, but there is also a lack of basic API documentation. I had to go to a Katalon forum to figure out about object parameterization. Why are the Web UI functions not explicitly documented? The links to the docs I've seen online are all dead.

- Issues with building project path/classes: sometimes if you try to write classes and use them in other classes (OOP) Katalon will not recognize the class and you have to restart the program for a clean build. This was most prominent in how the Cucumber tests have to be structured. Feature files and step definitions have to be in specific locations, and there is not really any official documentation for this.

- Git integration: While Katalon does come with Git integration, integration is limited to a project scope. If you clone a project through Katalon's interface, it treats the entire repository as a project which is kind of annoying.

- Reports: It seems strange that Katalon offers so much flexibility but then doesn't allow users to customize their reports and build them as they see fit.

- Object repository: There should be a way to import test objects/have a shared object repository between projects. Can you just put all your tests under one project? Yes, but it doesn't always make sense to do so and can lead to a cluttered project.

Avantages

Very fast to get up and running. Fits a variety level of users, flexible enough to allow advanced users to pretty much setup how they please at the same time enough of all the base needs for the new user. With it being free product, they update it regularly and are very attentive to user requests. Their application is actually fun to use. The setup and options are intuitive. Not hard to figure out how to do and implement even more complex, complicated operations with custom code. Very portable. The install being as isolated from the code, can easily install on another machine, and open project and be running tests, no special build, or install requirements to do this as I've seen in other tools.

Inconvénients

Not a fan of the Object Repository handling, doesn't do well of detecting dupes, can get quick messy if user of the object spy. The code repository integration is basic, the interface to it not very robust. Its scripting language is Groovy, which is not as popular as others.

Avantages

The tool is suitable to all people who will know and don't know the code, framework, error handle, data driven and deployment.

Inconvénients

1. I have faced some issue on sometime, like not able to call the method from keyword to test case.
2. Request to Katalon team to provide more reference.

Avantages

I liked Record and Playback feature.
Sauce labs, chrome and Firefox execution.
API execution is also very good and easy to implement for functional Testers.
Predefined Git options are very good.

Inconvénients

Debug feature is complicated.
Identify elements for desktop applications feature is not good using UISpy.

Avantages

Somewhat easy to get started (see cons), Git integration, beginner and expert modes. Ability to export and continue with other IDEs if desired to go outside of the tool (not locked in to it forever).
Plenty of information on the web to troubleshoot and ask questions (unlike our previous tool).
May frequent updates and feature releases.

Inconvénients

A little cumbersome to setup all the needed plugins. Until everything is configured just right, you will run in to errors here and there that take time to troubleshoot.
Test case navigation/folder structure could use a few more options and customization capabilities to be able to sort things better.
Automatic centralized location for code and test case storage (similar to ALM) would be great. Having to commit and pull code each time from different stations is cumbersome. To schedule remote execution you must make sure the machine pulled latest code which is an issue if execution and development PCs are different.

Avantages

It allow to somebody with no or little coding knowledge to get started in test automation with its intuituous interface and built in keywords. Also, with all the integration with various platforms and technologies make it a very easy to integrate tool in the day to day work environment.

Inconvénients

Some glitches still exist in some fields such as soap api calls where not all endpoints are loaded correctly and some improvemetns could be done in order to completely replace soap ui usage in my case. Also the cucumber integration doesn't seem to have all the solution's benefits working correctly such as tags and others that could be added. Finally the Database that is internal could allow to clone, copy, delete or manipulate data easily even the search is not there to make a query for instance.

Avantages

1. Integrations with GIT, Bitbucket, Slack
2. Data binding
3. variable binding
4. Execution settings
5. Compatible with other languages even though it is running using groovy
6. Profiles
7. Data files

Inconvénients

1. Better to have options to connect multiple databases with windows auth mode
2. Execution reports in katalonanalytics seem not running properly
3. API automation report doesn't have the flexibility to trace the issues easily we need to do many clicks

Avantages

Overall, the experience with record-play-customize code-replay has is reminiscent of its more expensive counterpart/s. But overall it's better than the other automation tools i used so far. online help and resources are bountiful. Object repository, test collection, input data files are some of my favorite places to work around with. there are other features which i havent explored yet, like mobile and API automation.

Inconvénients

There are certain customizations that i need with the software which are not yet supported (like full-page web screenshot and data file output), so our team is left to the care of old-school programming gurus on the web. the features that i miss is not a deal-breaker though, work arounds are fine by me for now.

Avantages

- Katalon Studio is easy to script
- Support multiple platforms(WEB UI, Mobile, API)
- Supports multiple Integrations for Reporting and Tracking

Inconvénients

- Newer versions have browser upgrade issue as each time we have to upgrade the browser for smooth execution. Most of the time it does not upgrade in one go.

Avantages

easy to handle and understand the product feature

Inconvénients

Nothing like that; looks i have all the feature looking for till date

Avantages

Katalon Studio is very good for automation testers and it develops a better-inbuilt framework
easy to deploy code to git

Inconvénients

it won't handle drag and drop Functionality efficiently
and upload image functionality also not good
and select value from drop down also not handled properly

Avantages

It's packed with features, which comes in handy when you want to perform many tasks with one single tool.
Getting started is easy, even for beginners; I have a few years of experience in automation with pure scripting and transitioning to a UI based tool was like going from riding a horse to driving a sports car.
SpyWeb is incredibly useful, I even prefer it to the recorder, which may seem faster at first, but in my experience it's been far more efective; selecting the right locator immediately after capturing the TestObject really saves time.
Databinding in test suites is a blessing, very easy to use and drive tests from this data.

Inconvénients

The UI is a bit clunky, not very intuitive, and I guess the word is "overpopulated". There are many options, buttons, dropdowns, popups, which can be confusing.
The learning process is fast at first, but when you are forced to use extended keywords, conditionals, method calling, the tool becomes a nightmare for beginner/intermediate users. I usually just write methods in script view, but many users have no experience in coding and really struggle with the UI assembly of methods or binary statements.
Debugging is somewhat confusing as well, but that's not so important in my opinion.
The application takes way too long to *start* running tests as the size of them increases (the execution is really fast though).

Avantages

Easy to setup
Easy to use UI - Objecy Spy, Recorder, Keyword and Script view, debugging, Integration with GIT etc..,
Easy to learn - Built in keywords, framework, simple external data integration, record and play back
Advanced Capabilities - Multi browser, parallel execution, command line execution, record / spy mobile applications, API etc..,

Inconvénients

Newer version of Katalon Studio has moved some of the free features to paid (ex. Jira integration)
Capturing objects, scripting and execution time on mobile apps must be improved
Multilevel API calls are not efficient compared to tools like SoapUI, Postman etc..
Report cannot be customized
Desktop app automation not available