Extreme Testing

3 Posts

Introduction to Manage ONTAP SDK  (Storage Systems,Host Agents and NetCache) & Manageability  SDK (DFM Servers)
===============================================================================================

 

If you have Storage System, Ops Manager, DFM Servers, NetApp Host Agents or NetCaches then it will be interesting to know about NetApp SDK. The NetApp SDK is a very convenient way to communicate with any of these systems by building your own solution. It has its own Programming interfaces which allow you to build your own applications/interfaces to sort out your requirement quickly.

 

First, a quick explanation of Data ONTAP APIs would be, Storage Systems have a CLI interface,SNMP and they have a web interface, via FilerView. They also have an API interface called Data ONTAP APIs (ONTAPI).  The exact set of available Data ONTAP APIs depends on what type and what version of software you are trying to communicate with. For Storage Systems, Host Agents and NetCaches use the NetApp Manage ONTAP SDKhelp pages for Data ONTAP API details and for Ops Manager, DFM Servers you need to look into to NetApp Manageability SDK (NM).

 

Getting started with SDK
==================

 

Download:

 

NetApp Manage ONTAP SDK     @ http://communities.netapp.com/docs/DOC-1110

NetApp Manageability (NM) SDK @ http://communities.netapp.com/docs/DOC-1152

 

 

What is Next ?

 

Getting started with an SDK can be a fun and a great journey, and lets hope we can get you off to a right start! .Once you have the SDK downloaded, to proceed with install, extract it into some directory structure you can work with. Then, for some tips and guidance of what to do, browse down to the following file:

 

<SDK>\doc\WebHelp\index.htm or using the shortcut <SDK>/SDK_help.htm

 

At this point, open the above help file in your favorite browser (IE or Firefox). The best place to start from there is in the "Getting started with the SDK" section. This will provide you with an introduction, overview, release notes, etc.  Enough to get you started and playing with the SDK!

 

Additionally, if you want to play around with some things like (with a simulator ) you can play around with a few tools (cli or gui) located in "SDK\bin\nt"  In there you will find zexplore and apitest - Launch them and you'll see what it brings for you to play with!

 

Meet Data ONTAP SDK utilities

=======================

 

Apitest

----------

An example set of Data ONTAP APIs is the system-get-version or system-get-info call. This can be used to show the Data ONTAP version. The apitest command allows you to do get and set values on the target system from your host system, whether your host is Solaris, Linux or Windows. Here’s the usage

 

linux-server> apitest -t filer -x filer1 root password system-get-info

INPUT:
<system-get-version/>

OUTPUT:
<results status="passed">
        <version>NetApp Release 7.3.1.1P4D2: Tue Jul 21 12:42:50 PDT 2009</version>
</results>

 

 

This example shows how to add a filer,  Filer1, to the list of Storage Systems monitored by the DFM Server running on a Linux Server.

 

linux-server> apitest -t dfm -x  mydfmserver root  password host-add host-name-or-id Filer1

INPUT:

<host-add>

        <host-name-or-id>Filer1</host-name-or-id>

</host-add>

OUTPUT:

<results status="passed">

        <appliance-id>XXX</appliance-id>

        <host-address>XXX.XXX.XXX.XXX</host-address>

</results>

 

The apitest command is actually part of the ONTAP SDK. This SDK includes C, Java, and perl interfaces to Data ONTAP API servers (Storage System). If you like perl then you can use the perl interface to make the same type of requests as you can make with apitest.

 

Usage:

apitest {options} <host> <user> <password> <API> [<paramname> <arg> ...]

Options:
  -i          API specified as XML input, on the command line

  -I          API specified as XML input, on standard input

  -t {type}   Server type(type = filer, dfm, agent, netcache)

  -r          Use RPC transport (Windows)

  -s          Use SSL

  -p {port}   Override port to use

  -x          Show the XML input and output

  -X          Show the raw XML input and output

 

<host> is the name of the target system. It is the Filer, DFM Server, Host Agent or NetCache you want to communicate with. <user> and <password> are the credentials to access that target system. Here are a couple example invocations.

 

 

Hello ONTAPI  Perl Sample Code Walk

==============================

 

use strict;

use lib '../../../lib/perl/NetApp'; ===================> Use the Netapp Perl SDK librariers
use NaServer;===============================>class for managing NetApp storage systems using ONTAPI(tm) APIs.

use Pod::Usage;

die pod2usage(
verbose => 1
) unless $ARGV[2];

our $filer = $ARGV[0];
our $user = $ARGV[1];
our $password = $ARGV[2];

our $s = NaServer->new($filer, 1, 1);
$s->set_admin_user($user, $password);=============>Set the admin username and password

our $output = $s->invoke( "system-get-version" );======>Submit an XML request already encapsulated as  an NaElement and return the result in another  NaElement.

if ($output->results_errno != 0) {
our $r = $output->results_reason();
print "Failed: $r\n";
}
else {
our $r = $output->child_get_string( "version" );=======>Gets the child named $version from the current object and returns its value.  If no child named $version is found, returns undef.

print "$r\n";
}

 

 

FAQs

====

 

o How to write my own solution using this SDK?

 

   Go to  SDK/src/sample path. You will find lots of sample code specific to languages (C,C#,Java,Per,VB.NET/). Try to use them as reference and program it.

 

o What is vFiler tunneling ?

 

 

    vFiler tunneling is a feature that enables an API to be invoked on a vFiler through the physical storage system on which the vFiler is contained. To access

    a vFiler, a user requires the IP address, user name, and password of the physical storage system alone.

 

    This feature is supported by the -v option of the apitest utility in the SDK.

 

 

    vFiler tunneling is supported by Data ONTAP 7.2.1 and later. While using the API na_server_set_vfiler, the client has to specify the ONTAPI version 1.7

    or  later.

 

   Before this feature was introduced, a user needed the IP address, user name, and password of both the actual storage system and the vFiler on which an

   API was to be invoked. It was a difficult task to maintain the details of the storage system and all the vFiler units on a network with a large number of

   vFiler units.

 

o How to Install SDK ?

 

     Its simple just download the zip file and unzip it to your prefered location.

354 Views Permalink Tags: manage, netapp, ontap, software, upgrade, admin, dataontap, manageability, virtualization, sdk, simulator, install, storage, command, (nm)

What it is ?

 

A tool that gives you the experience of administering and using a NetApp storage system with all the features of Data ONTAP at your disposal.How it works: The simulator can be loaded onto a Red Hat or SuSE Linux box and looks and feels exactly like Data ONTAP. It has the same code base (with additional wrappers to simulate the hardware) and is included in Engineering's nightly build process. The simulator is available for Data ONTAP 6.4.5 through 7.3.1.

 

Why it's cool ?

 

Almost anything you can do with Data ONTAP can be done with the simulator. Without purchasing new hardware or impacting your production environment, you can test functionality, export NFS and CIFS shares, set up fake tape drives, and even simulate two heads on the same box for clustering.

 

Advantages

 

  • Data ONTAP feature testing can be easily done. The simulator includes fully functional license keys for all NetApp software. You can create WORM-protected files using SnapLock® and a simulated set of populated disks, and after the test you just delete the files instead of throwing away drives. You can test NetApp SAN functionality using iSCSI before implementing in a production FC or iSCSI SAN environment. You can also experiment with features such as FlexVol™ and FlexClone™ before deploying Data ONTAP 7.0 on production systems.
  • Application integration. Application developers use the simulator to experiment with and develop applications that use Manage ONTAP™ APIs. The Manage ONTAP SDK (software development kit) contains documentation and C/C++, Java™, and Perl libraries.
  • Bug fix testing. The simulator can be used to confirm that a new release fixes a previous issue without having to physically touch a production machine. Assuming the bug fix is proven, you can test it on real hardware and know that time isn't being wasted with upgrades and downgrades.
  • Education. Every admin on your team can have a personal testing environment.

 

 

Download Data ONTAP Simulator...

 

You can download the Simulator images from http://now.netapp.com/NOW/cgi-bin/simulator .

 

Simulator Introduction on NTN can be found at http://communities.netapp.com/docs/DOC-1034.

 

I have taken an example of the Data ONTAP Simulator installation in Standalone Linux Box. I have taken SUSE 10 version and login with root user.

 

linux-sesl-184-54:/home/simulator # uname -a
Linux linux-sesl-184-54 2.6.16.21-0.8-default #1 Mon Jul 3 18:25:39 UTC 2006 i686 i686 i386 GNU/Linux

linux-sesl-184-54:/home/simulator # who am i
root     pts/0        Sep  5 14:42 (10.30.50.109)

 

 

Limitations:

 

This is not a production version of Data ONTAP and should not be used in your production environment. There are inefficiencies (for example, a 1GB disk file will be much larger than 1GB) and performance running on another OS without a disk system behind it will obviously be considerably less than with Data ONTAP. Simulator can’t hold disks more than 28 and approximately around 28GB in total size. Finally, the simulator can't emulate environments where specific hardware is required (for example, Fibre Channel).It is recommended that the Data ONTAP Simulator be installed on a non-production Linux system. Simulator installation scripts may replace the Red Hat libc library with an older more stable one. It's unlikely but possible  that other applications may be affected.

 

 

                                  NetApp Data ONTAP simulator installation steps

                                   -------------------------------------------------------------


Step I:

====

o Download the Data ONTAP simulator and keep it under home directory


linux-sesl-184-54:/tmp # mv 7.3.1-tarfile-v22.tar /home
linux-sesl-184-54:/tmp # cd /home/
linux-sesl-184-54:/home # ls
7.3.1-tarfile-v22.tar
linux-sesl-184-54:/home # pwd
/home
linux-sesl-184-54:/home # ls
7.3.1-tarfile-v22.tar

 

Step II:

=====

o Now untar the simulator installer.

 

linux-sesl-184-54:/home # tar -xvf 7.3.1-tarfile-v22.tar

 

Step III :

=====

o Once you have untarred the installer you will find the new folder simulator where the installer get extracted.


linux-sesl-184-54:/home # ls
7.3.1-tarfile-v22.tar  simulator

 

Step IV:

=====

o Change Driectory to the  extracted path

 

linux-sesl-184-54:/home # cd simulator/
linux-sesl-184-54:/home/simulator # ls
Vmware, Linux and Simulator installation.doc  disks.tgz  disks2.tgz  doc  license.htm  readme.htm  runsim.sh  setup.sh  sim.tgz

 

Step V:

=====

o Now run the installer script (setup.sh) to create the Single Node Simulator. If you wish to install Cluster Pair skip this step and perform Step VII.

 

linux-sesl-184-54:/home/simulator # ./setup.sh
Script version 22 (18/Sep/2007)
Where to install to? [/sim]:  =====================>  Choose your simulator install path.
Would you like to install as a cluster? [no]:
Would you like full HTML/PDF FilerView documentation to be installed [yes]:

 

Continue with installation? [no]: yes ===================================================> Enter "yes" to contiue the installtion

 

Creating /sim
Unpacking sim.tgz to /sim
Configured the simulators mac address to be [00:50:56:1:cd:eb]
Please ensure the simulator is not running.
Your simulator has 3 disk(s). How many more would you like to add? [0]: 2
Too high. Must be between 0 and 25.

Your simulator has 3 disk(s). How many more would you like to add? [0]: 2 =====================> Maximum available disk numbers for simulator (Choose the number of disks and size based on your Linux disk space)

 

The following disk types are available in MB:
        Real (Usable)
  a -   43   ( 14)
  b -   62   ( 30)
  c -   78   ( 45)
  d -  129   ( 90)
  e -  535   (450)
  f - 1024   (900)

If you are unsure choose the default option a


What disk size would you like to use? [a]: f    ===========================================> Choose the bigger disk size based on your need and the disk space availability

Disk adapter to put disks on? [0]:

Use DHCP on first boot? [yes]: no  ===================================================> Say "no" if you wanted to configure Static IP address

Ask for floppy boot? [no]:
Your default simulator network interface is already configured to eth0.

Which network interface should the simulator use? [eth0]:  ==============================> Choose the "interface" which you wanted to use for Data Traffic


Another simulator is running. Cannot give good advise about memory.

How much memory would you like the simulator to use? [512]: =============================> Choose the Default RAM size

Create a new log for each session? [no]:
Overwrite the single log each time? [yes]:
Adding 25 additional disk(s).
Complete. Run /sim/runsim.sh to start the simulator.
linux-sesl-184-54:/home/simulator #


Step VI:

======

o That's it, start the simulator by running startup script /sim/runsim.sh. And configure the Setup as per your need.

 

Step VII:

=====

o To configure the Data ONTAP Simulator for the (cluster)  Active Active Pair do the following

 

Script version 22 (18/Sep/2007)
Where to install to? [/sim]:
Would you like to install as a cluster? [no]: yes ====================================> Say yes to install the Active Active Pair (Cluster) Node
Continue with installation? [no]: yes
Creating /sim
Unpacking sim.tgz to /sim/node1
Configured the simulators mac address to be [00:50:56:1:15:27]
Unpacking sim.tgz to /sim/node2
Configured the simulators mac address to be [00:50:56:8:7c:b1]
Building cluster half for node /sim/node1
1024+0 records in
1024+0 records out
1048576 bytes (1.0 MB) copied, 0.006192 seconds, 169 MB/s
Building cluster half for node /sim/node2
1024+0 records in
1024+0 records out
1048576 bytes (1.0 MB) copied, 0.00734 seconds, 143 MB/s
Please ensure the simulator is not running.
Your simulator has 3 disk(s). How many more would you like to add? [0]: 25

The following disk types are available in MB:
        Real (Usable)
  a -   43   ( 14)
  b -   62   ( 30)
  c -   78   ( 45)
  d -  129   ( 90)
  e -  535   (450)
  f - 1024   (900)

If you are unsure choose the default option a
What disk size would you like to use? [a]: f
Disk adapter to put disks on? [0]:
Use DHCP on first boot? [yes]: no
Ask for floppy boot? [no]:
Your default simulator network interface is already configured to eth0.
Which network interface should the simulator use? [eth0]:
Another simulator is running. Cannot give good advise about memory.
How much memory would you like the simulator to use? [512]:
Create a new log for each session? [no]:
Overwrite the single log each time? [yes]:
Adding 25 additional disk(s).
Complete. Run the script /sim/node1/runsim.sh to start the first node, license clustering, then repeat with /sim/node2/runsim.sh.
linux-sesl-184-54:/home/simulator #

 

                                             FAQs

                                              --------


1. How to run CFO pair of Data ONTAP simulator ?

 

    o Follow the above installation Step VII and now there will be two node folder created in /sim path called as node1 and node2. You can run both the

       node together and configure the cluster pair

 

2. How to install Simulator from USB drive ?

 

    o First take the image in USB drive and insert USB drive to your desktop and mount the USB image onto the VM Host and follow the below steps exactly you

      can install.

 

 

      linux-sesl-184-54: cd /media
      linux-sesl-184-54:/media# cd USBDRIVE
      linux-sesl-184-54:/media/USBDRIVE# cd 7.3.1-sim-cdrom-image-v22
      linux-sesl-184-54:/media/USBDRIVE/7.3.1-sim-cdrom-image-v22# ./setup.sh

 

3. How to make Simulator to work in VmHost ?

 

     o If you cant ping/telnet the simulator ip address which runs on Vmware please try to enable the interface promiscuous mode using the following steps

       Modify the 'Promiscuous Mode' setting to 'Accept' on the vswitch to which the guest VM (hosting the Data ONTAP simulator) is connected to. From

      within the VI Client, perform the following:

 

  1. Select 'Configuration' Tab.
  2. Select 'Networking'.
  3. Select 'Properties' for the vswitch.
  4. Under 'vswitch', select 'Edit'.
  5. Select 'Security' Tab.
  6. Change the dropdown for 'Promiscuous Mode' to 'Accept'.
  7. Click OK.

 

After that try to ping or open Filerview using http://sim-ip/na_admin.

 

4. Where do I find Simulator Licenses ?

 

 

1 .Go to Filerview  - http://sim-ip/na_admin

 

2. Click on "Documentation Specific to the Simulator"

 

3.Click on "License Keys"  page from the http root on the system.

 

 

License

Key

Purpose

a_sisMTVVGAFDe-Dupe
nearstore_optionELNRLTG
cifsDZDACHDCIFS protocol
clusterJQIGWWFClustering of simulators
cluster_remoteN/A"Metrocluster" (cluster remote) does not work in the simulator
dafsN/ANot a shipping product
disk_sanitizationPZKEAZLDisk sanitization
httpNAZOMKCHTTP protocol
fcpN/AA license works but doesn't provide much functionality - use iSCSI
flex_cacheHFAYFJJFlexCache license
flex_cloneANLEAZLFlexClone license
gateway_hitachiN/ANo v-Series  functionality in the simulator
iscsiBSLRLTGiSCSI protocol
multistoreNQBYFJJMultiStore - multiple virtual Filers
nearstore_optionN/ACurrently unavailable in the simulator - is expected in a  later  version
nfsBQOEAZLNFS protocol
rapid_restoreN/ANot a shipping product
smdominoRKBAFSNSnapManager for Domino*
smsqlHNGEAZLSnapManager for SQL Server*
snaplockZOJPPVMSnapLock WORM Compliance edition
snaplock_enterprisePTZZESNSnapLock WORM Enterprise edition
snapmanagerexchangeBCJEAZLSnapManager for Exchange*
snapmirrorDFVXFJJSnapMirror between simulators
snapmirror_syncXJQIVFKSynchronous SnapMirror between simulators
snapmoverN/ANo back-end FCP support in the simulator
snaprestoreDNDCBQHSnapRestore
snapvalidatorJQAACHDOracle SnapValidator license
sv_linux_priZYICXLCOpen Systems SnapVault from Linux clients*
sv_ontap_priPVOIVFKSnapVault "primary" (source filer)
sv_ontap_secPDXMQMISnapVault "secondary" (destination filer)
sv_unix_priRQAYBFEOpen Systems SnapVault from UNIX clients*
sv_windows_ofm_priZOFNMIDOpen Systems SnapVault Open File Manager for Windows*
sv_windows_priZOPRKAMOpen Systems SnapVault from Windows clients*
syncmirror_localRIQTKCLSyncMirror (think RAID 4+1)
v-seriesN/ANo v-Series functionality in the simulator
vldN/ANot a shipping product

 

 

Note: Form 7.3 Simulators, you can use A-SIS and Nearstore also, you can run both  snapvault primary/secondary on the same node.

 

 

5. My simulator hangs during booting time, What should I do ?

 

   Data ONTAP  7.3.1 simulator the recommended memory is 512MB. But in 7.2.5.1 the smallest  simulator memory you should choose is 220MB.

   Try to increase the RAM by running setup script and start the simualtor

 

6. Is it possible to create VLANs in an Data ONTAP simulator?

 

 

    It doesn't work for virtual NICs in simulator (ns0/ns1), hence maybe unsupported.

 

7. Is it possible to have extra interfaces on the Simulator ?

 

   One of the known limitations in simulator is that it supports only 2 network  ports.

8. How to setup multiple simulators with DFM ?

 

   Install your simulator as per normal, then go into /install/path/node1 .You'll see a file called ,serialno. It contains 2 serial  numbers, the first being this node in the cluster, and the second being

   the serial number of its cluster partner (Incase you installed Cluster simulator). Edit this file so the serial numbers are different from the defaults and let them be unique. Now DFM will happily

   discover this simulator.

 

9. Which Data ONTAP Simulator supports De-Dupe ?

 

    De-Dupe is supported from Data ONTAP simulator 7.3 version.

 

10. Simulator started, but can't get into FilerView ?

  o Type "java" on the simulator console. If it says "Java not Enabled". Try to re-install simulator or try FAQ 11 and skip all below trials

  o  Check if the options httpd.admin.enable to be on.

  o  Try FAQ 3 if its a VmHost.

 

11. How do I get full Data ONTAP release root volume on Simulator ?

 

You can install a full release of Data ONTAP on to your simulator.  What will be  installed is basically just the kernel with some basic /etc files to get it  running.  So you'll need to expand your root volume to a reasonable size  (400MB), then grab the Data ONTAP image from the NOW site of the version you want.  Don't worry about the arch type, you won't actually be  installing the kernel anyway, that's already done.  Then load the bits on in  your favorite way (NFS/CIFS/software install, whatever).  Then reboot.  You  don't need to run download because it doesn't make sense on a sim anyway.

 

12. How to make the Data ONTAP Simulator to run on virtual NIC card ?

 

   -Say virtual interface is eth1, then "ifconfig eth1 0.0.0.0"

   -Copy MAC-address from eth1 and put it to the text-file called ",mac-address"  on your sim-directory

   -Setup your simulator to use eth1 as your sim-interface using setup script, set IP-address from  the same subnet as your eth0

   -You should be able to ping/mount/whatever from you simulator using eth1

 

13. How to add disks to simulator post installation ?

     Halt the simulator and you can run the following command

     1. You can run the Setup command and increase the number of disks mentioned in Step V

     2. If you want advanced command and dont like the above step you can run the following command

        #  . makedisks -n 4 -t 3

 

          Options:

 

               -n <additional number of disks to create>

               -t <disk type ID>

               -e <additional sectors>

               -a <adapter on which to start populating disks

2,041 Views Permalink Tags: software, web_server, web_install, storage, simulator, ontap, netapp, install, upgrade, dataontap, command, admin, web_server, web_install, upgrade, storage, software, simulator, ontap, netapp, install, dataontap, command, admin

INSTALLING Data ONTAP 7G – The easy way

 

Note:-

 

  This is not the only way of installing Data ONTAP on a filer.This is an easy way and all it takes is just a few minutes.


I) Where to get Data ONTAP?
======================

 

  http://now.netapp.com/NOW/cgi-bin/software

 

 

II) Downloading Data ONTAP to a web location:
==================================

 

Prerequisites-

 

  You should have a WebServer to Server the Data ONTAP installer. If you have your own webserver already running you can create a directory
  and keep the Data ONTAP installer there and point the Web location to the filer and you can skip to Setup 11111 . If you dont have one
  you can download the Webservers which are avialble in the Internet.

 

  I will explain a simple webserver installation using Google Mongoose

 

Note: Netapp Storage System just need any HTTP server which can serve the packet over TCP. Its upto to user to choose which type/branded HTTP server they wanted to use. For just a example I am going to continue here to explain with Google Mongoose.

 

 

  o Download the mongoose installer from http://code.google.com/p/mongoose/
  o Install it on C:/mongoose
  o Go to C:/mongoose and double click on mongoose.exe to start the Webserver.

 

  Thats it...

 

  Now keep/download the Data ONTAP installer into C:/. If you browse http://localhost then you should able to see content of the C:/ from
  the browser.

 

  Note : By default the mongoose Web Root folder will be set to c:\ you can modify it of your own folder.

 


III) Downloading & Installing the Data ONTAP  on the Filer
=========================================


Finding the required build on the filer-


Run the ‘software list’ cli command on the filer

  e.g.

f3020> software list

PC_ELFdist.zip

f3020>

 
Installing on a filer- Prerequisite:-

 
‘cf status’ should be off
It is better to have snapmirror off

 

IV)Upgrading the Data ONTAP to higher version
==================================

 

1. Get the web location of the build from where you have downloaded it.
  e.g. (http://laptopipaddress/PC_ELFdist.zip)

 
2. Use the command ‘software get  <web-location> -f'

    e.g (f3020> software get http://laptopipaddress/PC_ELFdist.zip -f)

 

  Note: Use -f flag will overwrite the previuos  downloaded file with the Same name. If you want to keep the old installer you have to use
  software get command with a different destination file name.

 
3. Use the command ‘software install  <PC_ELFdist.zip >'

   e.g (f3020> software install http://laptopipaddress/PC_ELFdist.zip -f)

 

  Note: Use -f flag will overwrite the previuos  downloaded file with the Same name. If you want to keep the old installer you have to
  use 'software install' command with a different destination file name.


4. This takes a few minutes. After all the files are copied, run the command ‘download’. You are writing the kernel to CF card and disk
     boot blocks. e.g. (f3020> download)


5. Once download is complete, run the version –b command, the primary.krn should be the newly installed version.
    e.g. (f3020> version -b)

 

6. Reboot the filer e.g. (f3020> reboot)

Once the filer reboots, the upgrade is complete.Cross verify the installtion using the version command.


V)Trouble shooting-
===============

1. Run the command ‘java’ on the filer. The message “Usage: java class_name [args]” should be displayed.

  e.g  (f3020*> java

        Usage: java class_name [args]

        f3020*>)

 

If the message “Java not enabled” displayed then you wont able to use launch Filerview and the Data ONTAP timed services. To enable Java on
Filer redo the upgrading steps (Steps 3 -6)

 

If the issue still persists, redo everything right from the start. (From downloading the build to the web location)

818 Views Permalink Tags: storage, web_install, snapmirror, ontap, netapp, command, admin, software, web_server, upgrade, install, dataontap, command, software, web_install, web_server, upgrade, install, dataontap, storage, snapmirror, ontap, netapp, admin


Daniel Prakash

Daniel Prakash

 Member since: Mar 5, 2008

Extreme Testing-Fit For Purpose

View Daniel Prakash's profile

Actions

Recent Comments

No recent comments.

Popular Blog Posts