Goal

Develop a brand new automation process that would meet the needs of a newly launched platform.

Background

The client’s product is a single architecture that allows for monitoring network flows, packets, user info, and resource data. The system’s functionality also includes events and log management, unusual activity detection, incident analysis and response, settings management, and the elimination of vulnerabilities. Once deployed, the analytics system enables a user to conduct correlation analysis in order to detect the most substantial threats, attacks, and vulnerabilities in real time.

The solution allows IT departments to process large volumes of data and prioritize incidents by severity. It automatically reacts to an incident and enforces compliance with requirements due to its ability to gather data, correlate it, and produce reports. A user may also run a predictive analysis for risks that already exist and have been caused by improper device setup or known vulnerabilities.

Challenges

The company’s QA testing process had already been streamlined and well-adjusted for quite a while. All tests had been covered by QA automation, and yet, after seven years, the customer felt the need to switch to a new platform; a platform that would meet all modernization requirements, improve the service provided by the company, and process data in a more secure and time-efficient manner.

The automation process that had been in place turned out to be incompatible with the new platform; it could not be integrated into the current process, either. It was these reasons underpinning the decision to construct a brand new automation process that would support present-day requirements and have the capacity to do so for years to come, based on projected growth.

Key Objectives

1. Determination of suitable testing types and approaches in line with the customer’s requirements
2. Setup of a manual testing process with a complete transition to  automation in the future
3. Selection of a tech stack for the creation of an automated testing user framework. This framework had to account for a complex system interacting with various third-party, highly secure services which combined API, database, and application tests
4. Development of the test automation framework and test scenarios that would fully cover the system’s functionality
5. Getting it all up and running
6. Generation of reports.

Solutions

The IBA Group team started by carefully learning the old process, domain, automation infrastructure, and software testing environment. After that, they studied the new platform in order to fully comprehend the course of action needed to be taken. The experts also analyzed multiple approaches to pick the one best informed by their own experience. In addition, they had to account for the customer’s requirements and tool limitations.

Be it dev testing or prod testing, in general, automated QA experts need to be fluent in manual testing, meaning they would know which approach to use and which test cases to put higher on a priorities list. Testing varies from project to project; sometimes, customers/manual testers/business analysts provide particular test cases for automation, but in this case, the client did not have a manual testing process per se.

Since the work went hand-in-hand with the migration to a new platform and not all services were automation-ready, the IBA Group team set up the manual testing process as an interim stage. That allowed for analyzing checks and determining which scenarios needed auto-test coverage. As the project moved forward, the team started building a new framework for automation that would support all technologies and achieve maximum coverage.

Benefits for the Customer

• Covered all the recent functionality and put manual testing into action
• Formulated requirements for a new user framework and picked technologies for their implementation
• Able to ensure an all-out auto-test coverage and quit manual testing altogether
• Thanks to the preparatory work done, the customer will soon enjoy shorter time-to-market and lower costs

Results

This project has demonstrated that the IBA Group team is capable of locating spot-on solutions for projects with sophisticated business logic, integrating systems with a multitude of services, and executing various types of testing within a single framework to better write, launch, and analyze QA testing scenarios and retrieve their results. All these allow the customer to examine product quality at any given point.

To learn more, please read about the test automation services we provide and the JUNASE solution we came up with.

Goal

Ensure testing of different application types within a single easy-to-use solution.

Challenges

The client’s system itself is a large-scale application with numerous business functions. Its automated scripts were aimed to solve the following problems:

• Long time dedicated to running regression testing
• The need to test applications on several environments and browsers
• High load on the QA team, who spent lots of time, effort, and consequently, money on manual tests
• Ever-growing testing expenditures that arose from the previous point
• Lack of timely and comprehensive reporting of test results

Key Objectives

1. Investigation of tasks and the tech used to develop the system as a set of applications interconnected via a single business logic. For example, the first application sees the order being placed, the second one sees the manager process it, while the third automatically generates the corresponding agreement
2. Selection of a proper tech stack and QA testing tools in order to build the testing automation process
3. Development of a BDD methodology-based test framework allowing the design testing of E2E scenarios and ensuring test data transferability across applications is integrated within the system
4. Coverage of the system’s complex, wide-ranging functionality by autotests
5. Integration of automated testing with CI/CD
6. User-friendly and prompt reporting functionality

Solutions

IBA Group undertook the following major testing automation stages:

1. Discovery of the client’s needs
2. Analysis of the client’s current system
3. Adoption of suitable automated testing types
4. Fine tune
5. Test data preparation and development of automated test cases
6. Launch of automated testing and report generation
7. Ongoing maintenance

Results

As part of cooperation, IBA Group helped the customer achieve the following outcomes:

● Architect a smooth, scalable testing automation process for its system’s functional capabilities

● Configure the launch of tests in the CI/CD environment and identify shortcomings faster and earlier. In this context, ‘shortcomings’  are application defects of any kind, such as bugs. We set up scheduled auto-test launches, so when an employee gets to a workplace in the morning, they see a report that contains the results of running (or not running) tests — and the tests can be run at any time, 24/7. If something malfunctions or simply does not work as intended, the employee is notified straight away and passes the issue to developers who can then swiftly fix it. It is of vital importance because the sooner the defect is discovered, the cheaper it is to remove, meaning it will not ultimately reach the production stage and by proxy, the user. As a result, the client gets more affordable resolution expenses and faster release times

● Cover part of the client’s system functionality with autotests

● Generate insightful and readily available results of automatic tests

● Obtain information on test stats thanks to our data-driven testing framework and user-friendly visualization of that data, made accessible from an intuitive interface

● Share these reports not only with the tech team, but also with business people since they are written in plain English and include screenshots and logs. They also show general automated testing indicators, such as time used to run, the total number of tests carried out, the passed versus failed scenarios diagram, and much more.

Read to learn more about IBA Group’s automated testing services and JuNaSe, IBA Group’s license-free full-cycle automated testing and quality assurance solution.

Challenges

Customer is one of the largest EU-based IT service providers.

Challenge: identify and eliminate vulnerabilities that could be the cause for unauthorized access to employee data before the production release.

Solution highlights

More than 30 vulnerabilities were successfully eliminated from the software to ensure the secure processing of user data.

Key Results

Based on the high value of the project results, Penetration Testing has been successfully integrated into the Customer’s HR Management System development cycle.

Challenges

Customer is a US-based AI writer service provider with significant number of reputation sensitive customers.

Ensure that end customer’s data cannot be compromised with the delivered solution.

Solution highlights

Around 20 vulnerabilities were successfully eliminated from the software before the product was introduced to the market (only 7 out of ~20 had low threat levels).

Key Results

High risk of personal data loss was reduced to a low level.

Challenges

Ensure that a delivered solution does not have security holes that could lead to customer’s sensitive data loss.

Identify vulnerabilities that could bring a high risk of product outage due to hacker attacks.

Solution highlights

Around 28 vulnerabilities were successfully eliminated from the software. 22 out of 28 vulnerabilities had either medium, high or critical threat levels.

Key Results

The customer’s audit was successfully passed after eliminating exploited vulnerabilities.

Situation

The customer develops insurance global web applications that enable insurance company employees to track operations and transactions. Web application and oracle forms are used by the end user within one test scenario. Data transfer between test scenarios and application types is essential.

The customer had unsuccessful experience with automation testing. The reason was selection of inappropriate approach and tools for automation testing.

Challenge

The Customer decided to setup automation testing process and create custom solution with external team, and then to maintain it by themselves. Therefore, the challenge was to build automation testing process from scratch.

Solution highlights

During the project, the team worked on the following tasks:

• approach and tools selection employing best practices in automated testing;
• end-to-end test scenarios automation with 2 application types (web-based and oracle forms);
• cross-browser automation testing: IE, Chrome, Edge browsers;
• CI pipeline setup to execute test automatically;
• configuration of automatically generated reporting;
• transfer automation testing workflow to customer.

Project results

Test team setup stable and easy-to-maintain test automation process. End-to-end test scenarios, that use both applications (web-based application and oracle forms) covered by automation testing within one solution. Custom automation testing solution was implemented with all JuNaSe solution benefits.

Test team also configured united report for test scenarios with 2 application types, and provided solution documentation (detailed Guideline with whole information regarding framework setup and usage) and knowledge-transfer sessions for team from customer side.

BUSINESS CHALLENGE

The customer develops a banking global application that allows bank employees to track banking operations, transactions, payments, transfers; work on several batches of documents at the same time; complete different types of deals; manage customer accounts, access etc.

The customer had manual testing process only. That took too many resources, especially during regression testing.

The purpose

Build automation testing process from scratch. The main purposes of using automation testing are:

• speed up delivery;
• save cost;
• manage scale (between all environments).

Solution

The project involved working on a web-based application and a mobile application.

For the web-based application, the challenge was:

• design automation testing framework for web-based applications from scratch;
• a big part of functionality should be covered by auto tests;
• the same tests should be run on 4+ environments.

For the mobile application the team needed to do the following:

• implement automation testing framework for mobile applications from scratch;
• the same tests should be run on two OS.

During the project, the team also worked on the following tasks:

• CI pipeline setup to execute test automatically;
• configuration automatically generated reporting.

Project results

1000+ auto tests implemented and run automatically every night on 4 environments.

Test Team setup stable and easy-to-maintain test automation process.
Significantly reduced manual/regression testing time. Automatically generated report helps to find issues in minimal time.

BUSINESS CHALLENGE

The project involves testing of the leading learning management system in multifamily of several applications in a training platform.

This training platform develops best-in-class online training courseware and administration solely for the Property Management Industry, designed to help people, teams and companies improve performance and reduce risk.

The customer had manual testing process only.

The purpose

Build automation testing process from scratch. The main purposes of using automation testing are:

• optimize testing activities, reduce manual testing time during regression testing;
• speed up testing;
• maximize test coverage.

Solution

During the project, the team worked on the following tasks:

• approach and tools selection employing best practices in automated testing;
• smoke and functional tests coverage by auto-tests;
• CI pipeline setup to execute test automatically;
• configuration of automatically generated reporting;
• transfer automation testing workflow to customer.

Project results

Test team provided stable and easy-to-maintain test automation process.

Smoke (fully) and regression (partially) tests covered by automation testing.

Custom automation testing framework was implemented with all JUNASE solution benefits.

Automatically generated report helps to find issues in minimal time.

Test team provided framework documentation (detailed Guideline with whole information regarding framework setup and usage) and knowledge-transfer sessions for team from customer side.