Currently Being Moderated
neto

Generating random zones for random I/O (with fio)

Posted by neto in Databases on Feb 7, 2013 9:10:19 AM

Hi All,

 

This is neto from Brazil

 

How are you?

 

Doing a POC and I am using an interesting feature on fio (https://freecode.com/projects/fio) to simulate random I/O

 

zonesize=int

              Divide file into zones of the specified size in bytes.  See zoneskip.

zoneskip=int

              Skip the specified number of bytes when zonesize bytes of data have been read.

 

I've created a script to use RANDOM numbers to be used for zonesize and zoneskip.

 

I am still working on it and as soon I have news I will update the post.

 

Thank you very much my friends

 

All the best

 

neto

NetApp - I love this company!

 

 

-- random.sh


cat > config.fio << EOF

[workload]

bs=8k

ioengine=windowsaio

iodepth=3

numjobs=16

direct=1

runtime=30

size=1024g

file_service_type=random

filename=\\\\.\PhysicalDrive1

filename=\\\\.\PhysicalDrive2

filename=\\\\.\PhysicalDrive3

filename=\\\\.\PhysicalDrive4

filename=\\\\.\PhysicalDrive5

filename=\\\\.\PhysicalDrive6

filename=\\\\.\PhysicalDrive7

filename=\\\\.\PhysicalDrive8

rw=randrw

rwmixread=80

rwmixwrite=20

thread

unified_rw_reporting=1

group_reporting=1

randrepeat=0

norandommap=1

zonesize=`echo $(( $RANDOM % 1048576 * 1048576))`

zoneskip=`echo $(( $RANDOM % 1048576 * 777))`

EOF

 

 

-- config.fio

 

[workload]

bs=8k

ioengine=windowsaio

iodepth=3

numjobs=16

direct=1

runtime=30

size=1024g

file_service_type=random

filename=\\.\PhysicalDrive1

filename=\\.\PhysicalDrive2

filename=\\.\PhysicalDrive3

filename=\\.\PhysicalDrive4

filename=\\.\PhysicalDrive5

filename=\\.\PhysicalDrive6

filename=\\.\PhysicalDrive7

filename=\\.\PhysicalDrive8

rw=randrw

rwmixread=80

rwmixwrite=20

thread

unified_rw_reporting=1

group_reporting=1

randrepeat=0

norandommap=1

zonesize=19799212032

zoneskip=21897414

 

 

-- FIO output

 

C:\Users\Administrator\Desktop\Performance>fio config.fio

workload: (g=0): rw=randrw, bs=8K-8K/8K-8K/8K-8K, ioengine=windowsaio, iodepth=3

...

workload: (g=0): rw=randrw, bs=8K-8K/8K-8K/8K-8K, ioengine=windowsaio, iodepth=3

fio-2.0.13-116-gf752

Starting 16 threads

Jobs: 16 (f=128): [mmmmmmmmmmmmmmmm] [100.0% done] [273.5M/0K/0K /s] [35.1K/0 /0  iops] [eta 00m:00s]

workload: (groupid=0, jobs=16): err= 0: pid=2432: Thu Feb 07 12:04:33 2013

  mixed: io=2358.2MB, bw=220017KB/s, iops=27502 , runt= 30039msec

    slat (usec): min=2 , max=2281 , avg= 6.62, stdev= 3.21

    clat (usec): min=138 , max=104461 , avg=1665.85, stdev=2977.54

     lat (usec): min=142 , max=104465 , avg=1672.46, stdev=2977.41

    clat percentiles (usec):

     |  1.00th=[  215],  5.00th=[  322], 10.00th=[  406], 20.00th=[  548],

     | 30.00th=[  796], 40.00th=[  860], 50.00th=[  916], 60.00th=[  972],

     | 70.00th=[ 1064], 80.00th=[ 1240], 90.00th=[ 3856], 95.00th=[ 7712],

     | 99.00th=[14784], 99.50th=[18304], 99.90th=[29568], 99.95th=[36096],

     | 99.99th=[61184]

    bw (KB/s)  : min=  749, max=15344, per=3.01%, avg=6630.30, stdev=4647.22

    lat (usec) : 250=2.38%, 500=15.13%, 750=8.71%, 1000=37.46%

    lat (msec) : 2=22.04%, 4=4.55%, 10=6.72%, 20=2.62%, 50=0.37%

    lat (msec) : 100=0.02%, 250=0.01%

  cpu          : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0

  IO depths    : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%

     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%

     issued    : total=r=826135/w=0/d=0, short=r=0/w=0/d=0

 

Run status group 0 (all jobs):

  MIXED: io=6454.2MB, aggrb=220016KB/s, minb=220016KB/s, maxb=220016KB/s, mint=30039msec, maxt=30039msec


Comments

Filter Blog

By date:
By tag: