benscode/stitcher-benchmark
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

add latency test cases and update readme

Browse source
This commit is contained in:
Muhamad Ibnu Fadhil 2025-11-19 14:14:09 +07:00
parent e3e0c9c21a
commit b29182600e
3 changed files with 13 additions and 42 deletions
Download patch file Download diff file Expand all files Collapse all files

13
README.md
View file

@ -6,12 +6,21 @@
``` ```
./request.sh -o <output_location> -u "<backend_url>" -i <iteration> --no-output ./request.sh -o <output_location> -u "<backend_url>" -i <iteration> --no-output
``` ```
- `-o` specifies the output folder
- `-u` backend url e.g: `http://stitchaton.local`
- `-i` (optional) specifies the range of the iteration e.g: 1-11 or just 3
- `--no-output` dumb the output to /dev/null
### Benchmark Throughput ### Benchmark Throughput
0. Have JMetter installed, [download here](https://jmeter.apache.org/download_jmeter.cgi) 0. Have JMetter installed, [download here](https://jmeter.apache.org/download_jmeter.cgi)
1. Go to `cd throughput` 1. Go to `cd throughput`
2. Run this in the terminal 2. Run this in the terminal
``` ```
./request.sh -o <output_folder> -H "<backend_ip>" -t <num_of_threads> -l <num_of_loops> ./request.sh -o <output_location> -H "<backend_ip>" -t <num_of_threads> -l <num_of_loops> -p <optional_port_default5000>
``` ```
3. outputs will be in the directory specified - `-o` specifies the output folder
- `-H` backend api without http or port e.g: 10.250.123.123 or stitchapi.local
- `-t` number of concurrent requests or threads
- `-l` number of loops of each concurrent requests e.g: 10 threads and 20 loops will result in 200 requests in total
- `-p` port number in which the application is served

2
latency/request.sh
View file

@ -48,6 +48,7 @@ titles=(
"09_A1-AE13-Entire_Left_Panel" "09_A1-AE13-Entire_Left_Panel"
"10_A14-AE42-Entire_Middle_Panel" "10_A14-AE42-Entire_Middle_Panel"
"11_A1-AE55-Full_Image" "11_A1-AE55-Full_Image"
"12_W48-Q46-ReversedTile_Small_Rectangle_image_3x6_tiles"
) )
payloads=( payloads=(
@ -62,6 +63,7 @@ payloads=(
'{"canvas_rect":"A1:AE13","crop_offset":[0,0],"crop_size":[1,1],"output_scale":1}' '{"canvas_rect":"A1:AE13","crop_offset":[0,0],"crop_size":[1,1],"output_scale":1}'
'{"canvas_rect":"A14:AE42","crop_offset":[0,0],"crop_size":[1,1],"output_scale":1}' '{"canvas_rect":"A14:AE42","crop_offset":[0,0],"crop_size":[1,1],"output_scale":1}'
'{"canvas_rect":"A1:AE55","crop_offset":[0,0],"crop_size":[1,1],"output_scale":1}' '{"canvas_rect":"A1:AE55","crop_offset":[0,0],"crop_size":[1,1],"output_scale":1}'
'{"canvas_rect":"W48:Q46","crop_offset":[0,0],"crop_size":[1,1],"output_scale":1}'
) )
# Determine the loop range # Determine the loop range

40
throughput/jmeter.log
View file

@ -1,40 +0,0 @@
2025-11-17 17:31:17,310 INFO o.a.j.u.JMeterUtils: Setting Locale to en_EN
2025-11-17 17:31:17,327 INFO o.a.j.JMeter: Loading user properties from: /opt/apache-jmeter-5.6.3/bin/user.properties
2025-11-17 17:31:17,327 INFO o.a.j.JMeter: Loading system properties from: /opt/apache-jmeter-5.6.3/bin/system.properties
2025-11-17 17:31:17,332 INFO o.a.j.JMeter: Copyright (c) 1998-2024 The Apache Software Foundation
2025-11-17 17:31:17,332 INFO o.a.j.JMeter: Version 5.6.3
2025-11-17 17:31:17,332 INFO o.a.j.JMeter: java.version=21.0.8
2025-11-17 17:31:17,332 INFO o.a.j.JMeter: java.vm.name=OpenJDK 64-Bit Server VM
2025-11-17 17:31:17,332 INFO o.a.j.JMeter: os.name=Linux
2025-11-17 17:31:17,332 INFO o.a.j.JMeter: os.arch=amd64
2025-11-17 17:31:17,332 INFO o.a.j.JMeter: os.version=6.14.0-35-generic
2025-11-17 17:31:17,332 INFO o.a.j.JMeter: file.encoding=UTF-8
2025-11-17 17:31:17,332 INFO o.a.j.JMeter: java.awt.headless=null
2025-11-17 17:31:17,332 INFO o.a.j.JMeter: Max memory =1073741824
2025-11-17 17:31:17,332 INFO o.a.j.JMeter: Available Processors =8
2025-11-17 17:31:17,340 INFO o.a.j.JMeter: Default Locale=English (EN)
2025-11-17 17:31:17,341 INFO o.a.j.JMeter: JMeter Locale=English (EN)
2025-11-17 17:31:17,341 INFO o.a.j.JMeter: JMeterHome=/opt/apache-jmeter-5.6.3
2025-11-17 17:31:17,341 INFO o.a.j.JMeter: user.dir =/home/ibnufadhil/Documents/projects/benchmark/throughput
2025-11-17 17:31:17,341 INFO o.a.j.JMeter: PWD =/home/ibnufadhil/Documents/projects/benchmark/throughput
2025-11-17 17:31:17,391 INFO o.a.j.JMeter: IP: 10.250.7.97 Name: SE-146 FullName: SE-146
2025-11-17 17:31:17,398 INFO o.a.j.JMeter: Loaded icon properties from org/apache/jmeter/images/icon.properties
2025-11-17 17:31:17,543 INFO o.a.j.JMeterGuiLauncher: Setting LAF to: com.github.weisj.darklaf.DarkLaf:com.github.weisj.darklaf.theme.DarculaTheme
2025-11-17 17:31:25,059 INFO o.a.j.s.FileServer: Default base='/home/ibnufadhil/Documents/projects/benchmark/throughput'
2025-11-17 17:31:25,061 INFO o.a.j.g.a.Load: Loading file: /home/ibnufadhil/Documents/projects/benchmark/throughput/stitcher-benchmark.jmx
2025-11-17 17:31:25,061 INFO o.a.j.s.FileServer: Set new base='/home/ibnufadhil/Documents/projects/benchmark/throughput'
2025-11-17 17:31:25,209 INFO o.a.j.s.SaveService: Testplan (JMX) version: 2.2. Testlog (JTL) version: 2.2
2025-11-17 17:31:25,236 INFO o.a.j.s.SaveService: Using SaveService properties version 5.0
2025-11-17 17:31:25,238 INFO o.a.j.s.SaveService: Using SaveService properties file encoding UTF-8
2025-11-17 17:31:25,240 INFO o.a.j.s.SaveService: Loading file: /home/ibnufadhil/Documents/projects/benchmark/throughput/stitcher-benchmark.jmx
2025-11-17 17:31:25,259 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for text/html is org.apache.jmeter.protocol.http.parser.LagartoBasedHtmlParser
2025-11-17 17:31:25,259 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for application/xhtml+xml is org.apache.jmeter.protocol.http.parser.LagartoBasedHtmlParser
2025-11-17 17:31:25,260 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for application/xml is org.apache.jmeter.protocol.http.parser.LagartoBasedHtmlParser
2025-11-17 17:31:25,260 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for text/xml is org.apache.jmeter.protocol.http.parser.LagartoBasedHtmlParser
2025-11-17 17:31:25,260 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for text/vnd.wap.wml is org.apache.jmeter.protocol.http.parser.RegexpHTMLParser
2025-11-17 17:31:25,260 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for text/css is org.apache.jmeter.protocol.http.parser.CssParser
2025-11-17 17:31:25,601 INFO o.a.j.s.SampleResult: Note: Sample TimeStamps are START times
2025-11-17 17:31:25,601 INFO o.a.j.s.SampleResult: sampleresult.default.encoding is set to UTF-8
2025-11-17 17:31:25,601 INFO o.a.j.s.SampleResult: sampleresult.useNanoTime=true
2025-11-17 17:31:25,601 INFO o.a.j.s.SampleResult: sampleresult.nanoThreadSleep=5000
2025-11-17 17:31:25,712 INFO o.a.j.s.FileServer: Set new base='/home/ibnufadhil/Documents/projects/benchmark/throughput'