Python Utilities
Different python utility scripts to help automate mundane/repetitive performance testing tasks. The readme page will continue to get updated as and when, I add new utility to the repo.
Note:
Most of these utilities are focused around performance testing/engineering. However with slight modification(/in some cases none) can be used in other fields too.
| Utility Link | Utility Link | Utility Link | Utility Link |
|---|---|---|---|
| 1: Merge Columns | 2: Unique and Sorted | 3: Histogram | 4: Extract Matched Data |
| 5: Swap Columns | 6: Randomize Data | 7: Unique Occurrence Count | 8: Split File By Text |
| 9: Heatmap | 10: Pivot Table | 11: Generate ABN And ACN | 12: Network Conversation Heatmap |
| 13: Creditcard Generator |
1: Merge Columns
This script merges columns from different files together and generates a new file.
2: Unique and Sorted
This script extracts data from a file, removes rows with no data, sorts and saves unique data into a file.
3: Histogram
This script generates response time distribution graph (histrogram) from the JMeter result CSV. Can be extended for others tools too.
4: Extract Matched Data
This script extracts response time data that matches a specific text in a column and saves into a new file.
5: Swap Columns
This script swaps columns in a file. Useful when trying to rearrange columns for easy of use/readability.
For demonstration purpose, the script rearranges JMeter result csv columns as I like them to view. However can be extended for other use too.
6: Randomize Data
This script randomizes data in a file. Useful when you want to have a random order of data in file for testing purpose.
7: Unique Occurrence Count
This script saves total number of occurrence of each unique item in a file. Useful for designing the test data distribution for testing.
8: Split File By Text
Extract data that matches a text in the data file and create a new file containing that data.
Useful when you have one big data file with all the data and you want to create separate data for each test script.
For example, you have one big data file that contains images, js & CSS URLs.
And you want to create a separate data file for CSS, js & images respectively. This script will help just do that.
In the below screenshot team was not part of the search text and hence no csv created for it. name is the column name in the file.
9: Heatmap
There might the times when it is not easy to notice small fluctuations in data using a line chart. This script generates a heatmap for the data where you are trying to observe patterns over minutes/hours but for a longer duration (i.e.30 days). For example, there might be a specific hour of the day when you see more load but it is not higher than the peak load in a day. Therefore line chart for a longer duration (i.e. 30 days) might hide that pattern or it might not be easily visible.
Same can be performed in excel using pivot table but will require some manual effort.
10: Pivot Table
This script converts extensive data (two/three column data) into a summairzed pivot table format. Useful when you want to have a summarized view of the requests/error/response time over long period.
11: Generate ABN And ACN
Generate random ABN and ACN numbers. Useful for performance/functional test scenario's that require valid ABN and/or ACN data for testing.
12: Network Conversation Heatmap
Convert network conversation captured in the trace file into a heatmap. Useful when you have a lot of conversations captured. This script makes it easy to visualize the conversations, if you are not comfortable reading/trolling the Wireshark network conversation view.
13: Creditcard Generator
Generate Mastercard/Visa creditcard numbers. Useful when dummy creditcard numbers are needed for Testing purpose ONLY. They are useless without the valid owner name, an expiration date and a valid CVV code. Therefore they CAN NOT be used for REAL transactions.
