Different terms/vocabularies/Tools used in automation Testing

Different terms/vocabularies/Tools used in automation Testing

Test runner — a tool that picks up files that contain unit tests, executes them and writes the test results to the console or log files. Mocha and Jasmine are two popular test runners used within the JavaScript community and TestNg/Junit in Java.

Assertion library — verifies the results of a test. Chai, Should, and Expect are examples of JavaScript assertion libraries and TestNg/Junit in Java.

Mocks — used in unit testing a component. A component under test has many dependencies. These dependencies are usually replaced by stubs or mocks. Stubs simulate a dependent object. Mocks offer an additional feature over stubs. With mocks, tests can be written to verify if the component under test has called the mocks as expected.

Mocking library — facilitates the usage of mocks in unit testing. Sinon and TestDouble are commonly used JavaScript mocking libraries and mockito in Java.

Other  Vocabs :

node.js - JS Environment

    Yarn - Package Manager

    npm - Package manager

Brew - Package manager

    OS level

Build Manager/task runner/Project manager

Java

 Gradle

 Maven

 Ant

 Ivy

Setting Java_Home Environment on MAC OS X

Setting Java_Home Environment variable for Appium on MAC OS X

• Open the Bash Profile to Edit it

• In the bash_profile add the following line: "export JAVA_HOME=$(/usr/libexec/java_home)"
• Save the changes
• Open CMD and Type : $ source ~/.bash_profile
• Verify if JAVA Home environment is set up on Mac by typing : $ echo $JAVA_HOME
• If it's properly installed you will get something like below image:

.bash_profile should be like this:

export JAVA_HOME=$(/usr/libexec/java_home)

export ANDROID_SDK_HOME=~/Library/Android/sdk 

export ANDROID_HOME=$HOME/Library/Android/sdk 

export PATH=${PATH}:$ANDROID_HOME:$ANDROID_SDK_HOME/emulator:$ANDROID_SDK_HOME/tools:$ANDROID_SDK_HOME/platform-tools:$ANDROID_SDK_HOME/tools/bin

Difficult finding elements in React Native App?? Here is the Solution

React Native Developer Tools

Finding Elements in RN application,the best way I found while working on React Native automation tool "Detox" by Wix.

Working on the automation can sometime be frustrating,it gets worse when you are working on a POC on new software Automation tool.The same I faced while working on Detox RN mobile automation tool.

Getting to the point "react-devtools" can help us to find testID,label,text etc including props and state with ease to help us automate RN apps.It can be installed as a global package or for the particular project itself.Below are the steps to install it globally.

Steps to Install the react-devtools standalone app:

• yarn global add react-devtools
• Once installed run the following command in terminal "react-devtools".
• From the in app developer menu click on "Toggle Inspector" and click on inspect to inspect element.

It will connect automatically for RN 0.43 or higher.

Tip:The shortcut to open toggle inspector on mac machine is "Command + D"

As soon as we inspect the components, the hierarchy is visible in the devtools and we can find the testID from it.

Once we start inspecting the element the react native dev tools highlighted components 

5 must step/approach to successful mobile testing strategy :

Subscribe to my youtube channel for more videos here:

5 must step/approach to successful mobile testing strategy :

Read about localization testing of the mobile app here : Quick Guide to INTERNATIONALIZATION,LOCALIZATION and GLOBALIZATION Testing for Mobile Application

Read about automation coding standards here: Avoid Mobile Automation Coding Pitfalls : Automation coding standards

Push Notification for Mobile Application

What is push notification?

Push Notification are messages that are sent by different app publisher's on different OS Android,iOS or any other OS.They can be sent even when the end user is not in the app.
Push Notification are of two type:

• Hard Push Notification : It has only one option to select.Force upgrade notification is the best example of it.On tapping on the aforesaid notification user land's to respective playstore to update the Application.
• Soft Push Notification : These are the messages having two options either perform that action or exit.

Note: The above are the Jargons used in my working environment and wording's may differ company to company.

How push notification works?

Operating system push notification service (OSPNS) acts as node to the App publisher to send the push notification to the end user.App publisher need to register themself on respective OS "OSPNS"
OSPNS for iOS is known as :Apple Push Notification's
OSPNS for Android is known as : Google Cloud to Device Messaging (C2DM)

IOS has notification center to control the them
In Android it can not be controlled at user level.

When push notification is useful?

The purpose of sending push notification is to increase :

• User Engagement : Like "Saif,we are missing you.You are having 10 new messages"
• Increasing ROI : Like "Book your flight now and get 10% off"
• Giving valuable information : Like "Your Etihad Flight is delayed by 2 Hours"
• Live Broadcast : Like "Cricket Score" and "Ronaldo hit a Goal just now"

Use Case of Push Notification?

When the End User hit's the push notification he should get desired information.

Test Cases for Push Notification?

1. Push Notification should come when the app is in background.
2. Push Notification should be received in the Language Sent.
3. We should not get multiple push notification.
4. Push notification should be sent to the target User only.
5. It should be received in different time zones also.
6. It should be visible on the notification Bar.
7. Turn of the internet,send the push notification and turn on internet.Push notification should be received.

Memory Leakage Testing for Mobile Applications

Memory Testing is the non functional testing of the Mobile Application which is performed to test how iOS,Android,Windows based application are consuming the RAM.

Following high level points are to be concerned:

• The Application should work well at low memory also,it should not lag.
• In case the memory is low and we want to install the application which require higher memory then we should get proper validation.
• Verify that your application isn’t too heavy keeping in mind your competitor’s application.
• There should be no memory leakage.
• Monitor the use of Memory by the Application using Eclipse/*Android Studio (Android Monitor) which can also help in analyzing network, GPU and CPU usage  or any third party Memory Monitoring tool .

Tip: During and use and debugging of app, track the memory monitor. If the memory usage graph rises for your app and doesn’t fall even if put in background, it’s a memory leak.

*To read how we can use utilize Android Monitor in Android Studio click on the Link

Still from Android Monitor:

Image Source:Developer.Android.com

Mobile DeepLinking for Android and iOS Native Application

"MobileDeepLinking" How it can save your million Dollar and effort too!!

1. Did you ever navigated from One Native Application to another Native Application without leaving the Application itself? You might not have really virtually felt it but you did. 
2. Have you ever authenticated one Native Mobile  Application to open another Mobile application without exactly launching the Application? Ever used Tinder, authenticating your profile with Facebook?
3. While reading any news,there was a tweet embedded into the Application and when you clicked on that you navigated to twitter?

If the answer to above question is yes, you have been using deep links!!

What are Deep Links:

Deep links are the URI uniform resource identifier that helps you to navigate on another Application with or without leaving the application like fb://profile

They are different from websites which have URL like www.tripsource.com

Deep linking’s for Mobiles are briefly bifurcated into two type's:

• Deferred deep links: The Native Application is not yet installed but deep links invokes you to install the application or opens the mobile browser and then navigated to the deep link URI
• Contextual deep link: The Native Application get’s launched when invoking the URI, remember Tinder Facebook relationship?

How can Deep Linking be useful?

I will be sharing here my real time experience with the best utilization of mobile deep linking in my previous project.

You have a native application for android, iOS, windows and responsive site. Now the requirement comes that we need to implement an MVP for hotels in a Travel Planner. It will require certain effort/reource to implement the MVP on android , iOS and responsive site platform but we don’t have that much time.

Any Solutions??

Now this is when Mobile Deep linking will come to our savior.

Now we will implement the MVP on responsive site and then access the MVP from responsive site in the native of the iOS and Android application.

                                 

Look’s simple,it’s not that simple when you will start testing it ;).

Use Cases for testing Mobile Deep Links

1. UI issues and glitches on native applications Android and iOS
2. Session handling, remember you are booking a Hotel and not 2 cent chocolate.
3. Bit of security testing Authentication token/authorization handling in, may be a tech geek friend of your’s is spying you and tricks you to book hotel in his name by intercepting response.
4. Localization Testing and Internationalization Testing, definitely I won’t like to view the website in any language that I don’t understand and my default language of native application was set to my native place.
5. While accessing Mobile deeplinkings it’s recommended to use proper MobileDeepLinking URLS and iOS/Android libraries for the same.

Here are a few examples of deeplinks for popular apps on iOS: Developer Deeplink – e.g. Purpose Twitter twitter://timeline Opens the Twitter app and links to the user’s timeline Facebook fb://profile Opens the Facebook app and links to the user’s profile Yelp yelp:// Opens the Yelp app (note: this example does not include any routing parameters) Special thanks to TravelPort Digital and BCD Travel Image Source: Google

Let's Goal the "CRASH" with "HOCKEY"

Let's Goal the "CRASH" with "HOCKEY"

Gone are the day’s when we use to take out crash out logs from Monitor.bat file from Android Devices using CatLog and syncing iTunes with the device to take out crash logs from iOS devices.

Now we have more sophisticated product/Application  that can help us in digging into any application crash that are happening in any environment be it Developer Environment, QA Environment, Staging Environment, UAT Environment and the most important one Yes, right the Production Environment.

Most of the tools mentioned are quite simple to implement we just need to integrate the SDK  of these Crash reporting tool in our Mobile application.

The products that I prefer or have used in my experience to take out log’s from mobile application are:

1.       Crashlytics (Fabric): Twitter acquired crashlytics. It is one of the most powerful tool to take out crashlogs for your application, With neat and clean UI once you get a crash it’s shoot a mail to the officially registered Email ID and then we can inspect the issue along with the device and test environment we got the crash on.

It has various other information like Total Crash Count, Crash Graph, Android Device Breakdown Charts, Android Operating System Charts, Free Space Etc.

2.       Hockey: HockeyApp which is owned by Microsoft is a web-based platform that manages its users’

betas and collects live crash reports for iOS, Android, and more apps.User Metrics, Application Distribution and Crash Reporting it does it all.  

There are many other tools that are quite popular for taking out crash logs from Android and iOS devices namely:

•  Crittercism
•  BugSense
• Firebase Crash Reporting
• AppSee

 Disclaimer: Image Source google.com

Device Matrix for testing iOS,Android and Windows application as of 2021

Device Matrix for testing iOS,Android and Windows application as of 2017 

As we know we have clustered and segmented fragmentation of different OS and Screen size of device it's become impossible to test almost all types of device or OEM that is Original Equipment Manufacturer.

To an extent we have an streamlined fragmentation of iOS devices with iOS 11 being the latest version released at the time of writing blog with iOS X and iPhone 8 being the latest device released by Apple and same goes for Windows devices but for Android it's have a completely different picture which is having more OS versions like Ice Cream Sandwich, Jelly Bean,Kit Kat,Marshmallow ,Nougat and Oreo and multiple OEM like Samsung,HTC,Motorola,Lenovo,LG,Micromax etc.

The most problem we are likely to face because of device fragmentation are but not limited to:

1.     Crashes due to non customized system Library

2.     Memory Issue with low end devices.

3.     User Interface issue due to different resolution screen. 

Here is the compiled list of Device Matrix for testing iOS,Android and Windows application as of 2017 that I would prefer to test my application on:

OS	Device Name	Screen Size	Screen Resolution		PPI
iOS	Iphone X	5.8	1125x2436	458
	iPhone 8	4.7	1334x750	326
	iPhone6	5.5	1334x750	326
	iPad Air 2	9.7	1536x2048	264
Android	Samsung Galaxy Note 5	5.7	1440x2560	515
	Google Pixel	5.0	1080x1920	534
	Samsung Galaxy S6	5.1	1440x2560	515
	Google Motorola Nexus 6	6.0	1440x2560	515
	HTC one M9	5.0	1080*1920	440
	Samsung Galaxy S Tab	8.4	2560x1600	287
Windows	Microsoft Lumia 950 XL	5.7	1440x2560	518
	Nokia Lumia 720	4.3	480x800	217

For Latest android devices used widely we can take help from Android Dashboard.

Testing Rest API with Postman

What is Rest API.

A RESTful API is an application program interface (API) that uses HTTP requests to GET, PUT, POST, and DELETE data.

What is the Architecture of API

• HTTP headers used for authorization and generation of token it also has content-type mostly as application/JSON
• HTTP Request  (POST,GET,PUT,DELETE )
• Status Code/ Response Code :2XX,3XX,4XX,5XX

To install the extension of PostMan on Chrome follow step:

1. Open a Google chrome
2. Click on: https://chrome.google.com/webstore/detail/postman/fhbjgbiflinjbdggehcddcbncdddomop?hl=en
3. Launch app

Now for Testing the API we need a testing Endpoint

1. Enter the URL of the API in the URL textbox
2. Select the type of Http method like POST
3. Provide the Header 
4. Now click on send
5. You will get a response if the API is up and Working

Still in the process of writing this article, Sorry for any inconvenience. Happy Reading. 

Interview Experience with AMAZON for the role of Quality Assurance Tester

This role was for Digital/ IoT/Mobile Application based testing :) 

Amazon is a dream company and everyone wants to work for that company and I am no exception. Recently I interviewed amazon for the role of QAT  Quality Assurance Tester for their Alexa product which utilizes Voice Recognition, Artificial intelligence like techs which seamlessly blends with some IoT devices. It was an amazing experience for me.
Though I made it till the last round I was not able to make in the Amazon Leadership Principle Q/A session.

Here are the brief list of questions asked:

Scenario-Based Questions with my Answers:

• List me some scenario for the Uber car booking application-

1. Launching the Application on different OS and Version
2. Accent and Localization based scenario
3. Location(GPS Based scenario)
4. End The trip (By driver or the end-user)
5. Location not available
6. Pick up and drop and off location should not be similar
7. Wifi service: Should be working on 2g/3g and Wifi
8. Booking confirmation message on Mobile Number
9. Test case for find cab later if there is no other cab available at that time
10. Book a new cab once the trip has ended.

• How to debug Image UPLOAD options for any Application-

1. Verify the OS of the system like Unix, the browser like Safari, and then the version of the browser by narrowing the possibility and finding the root cause of the bug.
2. Try replicating the scenario on different machines.
3. Also, verify if the Image file type like JPG is supportable or not.
4. Debug the application using the third party debugger tool and take out the JSON response of the application which can help the developer to debug more.

• Speech/Voice Recognition scenario for IoT and Mobile Based Application:

1. Dialect/Accent of the user should be clear to the IOT machine and app.
2. Different supported Languages like English, German should work seamlessly.
3. Localization/Internationalization should be as per the target market.
4. The content fetched should be genuine like if I am searching for "Michael Jackson album" then no other content should appear.
5. When searching for flights with the apps having VR the application should not crash and Origin and destination location should be precise like "Book flight from DELHI-BANGLORE"

• You have only one field which is Date Picker write Test Cases to test it-

1. The format of the date picker may be dd/mm/yyyy as per requirement.
2. It should not support any other format apart from requirement like mm/dd/yyyy
3. Should be able to select future test dates.
4. Timezone: What if I select the date in India and  at the same time I select the date in any other location like London
5. Need to verify the Leap Year functionality 
6. Restrict the app to select past dates (As per requirement)

Amazon Leadership Questions:

1. Define your KRA in your current Organization
2. How you were able to provide Customer Satisfaction to your customer.
3. What feedback you got from your client while working on any project.
4. Do you know what role you will be provided at Amazon and how you will be able to leverage it?
5. How you were able to optimize the cost at your organization for which they have benefited. 

Google Analytic:To redefine your Mobile Testing Strategy

Google Analytics:To redefine your Mobile Testing Strategy:

Many times I came across questions like How Google analytic can increase test coverage and how it can help in improving the quality of the product. Let’s understand this:

Overview

Google Analytics is a tool/service which helps in tracking events and reporting website traffic. It can be embedded into the web and the mobile applications via Google Analytics for Mobile Apps, an SDK that allows gathering usage data from iOS and Android Apps.

 

What meaning information we can take out from Google Analytics:

1. It can help in creating Device Matrix for testing purposes as it can help us in determining the popular devices used by the end-user so that these devices are on the Checklist to do the testing of the application first along with the OS like Android, iOS with their version.

 

2. The most used pages or landing pages.

 

3. With events, we can figure it out if all the buttons, links, etc are triggered correctly.

 

4. Figure out the performance of the Application by viewing landing page bounce rates, average time on page, page depth, site speed

 

5. If something works on a Mobile device for responsive web design but not on the Desktop Browser.

 

6. To figure out the installation/uninstall rate. 

 

7. To figure out the crashes if it’s happening at any particular screen.

 

8. To determine the location of the target users and from which location we are getting heavy traffics. 

 

9. To figure out on which page the End users are quitting the application most.