Testing for update EMI 1.0.1rc4

From NorduGrid
Jump to: navigation, search

Organization of testing

Media: ARC_test_plan_v0.4.doc

Infrastructure

ARC-EMI testbed EGIIS (running ARC 1.0.0), which can be accessible over

ldapsearch -h arc-emi.grid.upjs.sk -p 2135 -x -b 'mds-vo-name=ARC-EMI,o=grid' -s base giisregistrationstatus

The grid-monitor is at http://arc-emi.grid.upjs.sk/gridmonitor/ EGIIS using 1.0.1rc4 code. and it is accessible over

ldapsearch -h testbed-emi1.grid.upjs.sk -p 2135 -x -b 'mds-vo-name=ARC-EMI-1.0.1,o=grid' -s base giisregistrationstatus

its grid-monitor is running at http://testbed-emi1.grid.upjs.sk/gridmonitor/loadmon.php


CE ARC1: rc1.grid.upjs.sk:50000/arex (1.0.1rc4 running, without patch)

CE ARC0: rc0.grid.upjs.sk (1.0.1rc4 I cannot submit job LDAP problem, I need to apply patch)

Communication ports

Port no. Type Component
localhost, 127.0.0.1 local BDII
443
2135-2137 LDAP, BDII
2811 GridFtp
9000-9300 or 9000-11000 GridFtp
15001-15003 Torque
50000 Type AREX
60000 Type

Availability of testers during 20.7-21.7.2011

http://doodle.com/4de6fic66hz7rrr7

List of testers

ARC CORE

Marek, Anders, Zsombor

ARC CE

Marek, Anders, Samir, Adrian, Florido


ARC CLIENT

Marek, Anders, Jozef, Salman, Mattias, Jon, Martin Skou, Eva


ARC INFO

Marek, Anders, Adrian, Mattias, Florido


ARC GridFtp

Anders, Marek, Mattias, Salman, Jon



Relevant documents


How to report the results

Tester writes test report. The test report has unique structure

-Description of problem (for example description of bug with link to bugzilla)
-Test scenario (all details needed to reproduce test)
-Infrastructure used to perform test (for example testbed with specification of software)
-Expected results
-Output of test (for example stdout, stderr)
-Comments and proposals (should be used as feedback for developers) 
-The final decision PASSED/FAILED


Test report must be copied in the Test report for EMI comp[onents (wiki) Follow structure of reports recommendation is to keep order of items (for example regression tests bug 1, 2 , 7)

Notes

Regression testing:

If bug is successfully verified change status in bugzilla  to VERIFIED, then provide information about the result in the initial table in the wiki


1.0.1rc4

1.0.1rc4 (Revision 22257)

Priority tasks -actual status

Deploiment tests

Testing deployment of ARC Information System components is priority

The ARC packages (including rc1 of ARC 1.0.1 release) intended for the upcoming EMI-1 update release are now available from the official testing repo

http://emisoft.web.cern.ch/emisoft/dist/EMI/testing/1/sl5/

the corresponding repo file is this

https://twiki.cern.ch/twiki/pub/EMI/EMI1Updates/testing.repo

The ETICS configurations used for producing the packages are under emi-arc_R_1_0_1_4 subsystem configuration in emi/arc ETICS subsystem.

The specific tags used in configuration are:

arc1/tags/1.0.1rc4
arc0/tags/compat_1.0.0
doc/tags/1.0.1
packaging/fedora/nordugrid-arc-meta/tags/1.0.1

Deploiment tests - Marek

EGIIS

Observations:

DEPLOYMENT SUCCESSFUL

The config file I used for EGIIS was:

[common]
hostname="testbed-emi1.grid.upjs.sk"
x509_user_key="/etc/grid-security/hostkey.pem"
x509_user_cert="/etc/grid-security/hostcert.pem"
x509_cert_dir="/etc/grid-security/certificates"
[infosys]
overwrite_config="yes"
oldconfsuffix=".oldconfig"
hostname="testbed-emi1.grid.upjs.sk"
port="2135"
debug="1"
slapd_loglevel="1"
slapd_hostnamebind="*"
threads="128"
timelimit="1800"
registrationlog="/var/log/arc/inforegistration.log"
providerlog="/var/log/arc/infoprovider.log"
provider_loglevel="2"
limit_core="0"
limit_nofile=""
user="root"
infosys_compat=enable
infosys_nordugrid=enable
infosys_glue12=disable
infosys_glue2_ldap=disable
bdii_location="/usr"
bdii_tmp_dir="/var/tmp/bdii"
bdii_var_dir="/var/run/bdii"
bdii_log_dir="/var/log/bdii"
bdii_cmd="/etc/init.d/bdii"
bdii_update_cmd="/usr/sbin/bdii-update"
[infosys/index/ARC-EMI-1.0.1]
name="ARC-EMI-1.0.1"
allowreg=* 
[infosys/glue12]
resource_location="Kosice, Slovakia"
resource_latitude="0"
resource_longitude="0"
cpu_scaling_reference_si00=2400
processor_other_description='Cores=3,Benchmark=9.8-HEP-SPEC06'

the EGIIS service installed with RC of 1.0.1 packages is available from testbed-emi1.grid.upjs.sk and can be used for registering any cluster (until we are done with testing). Its grid-monitor is located at http://testbed-emi1.grid.upjs.sk/gridmonitor/loadmon.php

Compute-Element

DEPLOYMENT SUCCESSFUL after applying patch suggested by Daniel (the pid problem), the CA packages have not been installed but because the metapackage version has not been updated to 1.0.1, will be fixed with next build.

The configuration used was following:

[common]
pbs_bin_path="/usr/local/bin"
pbs_log_path="/var/spool/torque/server_logs"
hostname="testbed-emi4.grid.upjs.sk"
lrms="pbs"
globus_tcp_port_range="9000,11000"
x509_user_key="/etc/grid-security/hostkey.pem"
x509_user_cert="/etc/grid-security/hostcert.pem"
x509_cert_dir="/etc/grid-security/certificates"
gridmap="/etc/grid-security/grid-mapfile"
[vo]
id="vo_1"
vo="ARC_Community"
source="http://www.nordugrid.org/community.dn"
source="http://vls.grid.upjs.sk/comunity.dn"
source="http://vls.grid.upjs.sk/demo-dn-list.dn"
source="http://www.knowarc.eu/knowarc.dn"
source="vomss://arthur.hep.lu.se:8443/voms/knowarc.eu?/knowarc.eu"
source="vomss://emitestbed07.cnaf.infn.it:8443/voms/testers.eu-emi.eu?/testers.eu-emi.eu"
mapped_unixid="gridtest"
require_issuerdn="no"
[group/users]
name="users"
vo="ARC_Community"
[grid-manager]
controldir="/var/spool/nordugrid/jobstatus"
sessiondir="/scratch/grid"
#sessiondir="/mnt/storage"
scratchdir="/scratch/scratch"
runtimedir="/SOFTWARE/runtime"
cachedir="/scratch/cache"
user="root"
mail="grid.support@somewhere.org"
joblog="/tmp/gm-jobs.log"
securetransfer="no"
debug="5"
[gridftpd]
debug="3"
logfile="/var/log/gridftpd.log"
logsize="100000 2"
pidfile="/var/run/gridftpd.pid"
port="2811"
pluginpath="/usr/lib64/arc"
encryption="no"
allowunknown="no"
maxconnections="200"
#unixmap="nobody:nobody all"
unixmap="gridtest:gridtest all"
[gridftpd/filedir]
plugin="fileplugin.so"
path="/unixacl"
mount="/scratch/tests"
dir="/ nouser read cd dirlist delete create *:* 664:664 mkdir *:* 775:775"
[gridftpd/jobs]
path="/jobs"
plugin="jobplugin.so"
allownew="yes"
[httpsd]
user="root"
debug="2"
logfile="/var/log/httpsd.log"
logsize="100000 2"
pidfile="/var/run/httpsd.pid"
gsiport="8000"
sslport="8001"
#plugin="/opt/nordugrid/lib/se.so"
[se/filedir]
name="filedir"
assigned_storage="filedir"
alias="KE-testbed-emi4-unixacl"
comment="Under test"
type="gridftp"
[infosys]
overwrite_config="yes"
oldconfsuffix=".oldconfig"
hostname="testbed-emi4.grid.upjs.sk"
port="2135"
debug="2"
slapd_loglevel="3"
slapd_hostnamebind="*"
threads="128"
timelimit="1800"
registrationlog="/var/log/inforegistration.log"
providerlog="/var/log/infoprovider.log"
provider_loglevel="3"
limit_core="0"
limit_nofile=""
user="root"
infosys_nordugrid=enable
infosys_glue12=disable
infosys_glue2_ldap=enable
bdii_location="/usr"
bdii_tmp_dir="/var/tmp/bdii"
bdii_var_dir="/var/run/bdii"
bdii_log_dir="/var/log/bdii"
bdii_cmd="/etc/init.d/bdii"
bdii_update_cmd="/usr/sbin/bdii-update"
[cluster]
cluster_alias="testbed-emi4-UPJS"
cluster_location="SK-04001-Kosice"
cluster_owner="UPJS"
clustersupport="marek.kocan@upjs.sk"
lrmsconfig="single job per processor"
homogeneity="True"
architecture="adotf"
nodecpu="AMD64 Processor @ 3500+ MHz"
opsys="SL5 64bit"
nodememory="1024"
middleware="from SVN"
nodeaccess="inbound"
nodeaccess="outbound"
dedicated_node_string="AMD"
gm_mount_point="/jobs"
gm_port="2811"
cachetime="30"
timelimit="30"
sizelimit="10"
[infosys/glue12]
resource_location="Kosice, Slovakia"
resource_latitude="0"
resource_longitude="0"
[infosys/cluster/registration/ARC-EMI-1.0.1]
targethostname="testbed-emi1.grid.upjs.sk"
targetport="2135"
targetsuffix="mds-vo-name=ARC-EMI-1.0.1,o=grid"
regperiod="60"
registranthostname="testbed-emi4.grid.upjs.sk"
registrantport="2135"
[queue/gridlong]
name="gridlong"
homogeneity="True"
scheduling_policy="FIFO"
comment="gridlong"
queue_node_string="AMD"
totalcpus="1"
cachetime="30"
timelimit="30"
sizelimit="5000"
[infosys/se/filedir/registration/sefiledirARC-EMI-1.0.1]
targethostname="testbed-emi1.grid.upjs.sk"
targetport="2135"
targetsuffix="mds-vo-name=ARC-EMI-1.0.1,o=grid"
regperiod="180"

Summary Table

Test Description Component Tester Result
clean CORE Marek PASSED
upgrade CORE Marek PASSED
clean CE Marek PASSED (patch for bddi-update had to be used)
clean CE Jozef PASSED
upgrade CE Marek PASSED
clean CLIENT Jozef PASSED
update CLIENT Jozef PASSED
clean INFO Florido, Marek PASSED
upgrade INFO Florido, Marek PASSED but doesn't check for the new BDII version

Static Code Analysis

Sloccount

cpp:         142284 (74.48%)
perl:         18564 (9.72%)
php:          14347 (7.51%)
python:       10611 (5.55%)
sh:            4378 (2.29%)
ansic:          802 (0.42%)
java:            63 (0.03%)

The complete results of SLOC count for entire ARC code can be found here:(http://testbed1.grid.upjs.sk/static_code_analysis/nordugrid-arc-1.0.1rc4.sloccount)

CCCC metrics

Metric Tag Overall Per Module
Number of modules NOM 943
Lines of Code LOC 110409 117.083
McCabe's Cyclomatic Number MVG 32558 34.526
Lines of Comment COM 12925 13.706
LOC/COM L_C 8.542
MVG/COM M_C 2.519
Information Flow measure ( inclusive ) IF4 663492 703.597
Information Flow measure ( visible ) IF4v 662760 702.821
Information Flow measure ( concrete ) IF4c 3739 3.965
Lines of Code rejected by parser REJ 3319

The complete results for CCCC for entire ARC code can be found at http://testbed1.grid.upjs.sk/static_code_analysis/nordugrid-arc-1.0.1rc4.cccc/

Regresion Tests

List of bugs to test (grouped based on priority)/regression testing

BLOCKER

bug description component tester result
2236 Uploaders hangs CE Marek PASSED
2436 YUM repository configuration is wrong CLIENT Marek CLOSED long time ago
2475 XRSLParserTest fails on some 64bit platforms: RHEL 4+5, SL5, Fedora 5+6 CLIENT Marek PASSED (tested for CentOS5 32bit, SL5 64bit, SL6 64bit)
2482 looping downloader CLIENT Marek PASSED
2450 GGUS-Ticket-ID: #72340 EMI1 ARC CE 1.0.0 wrong user mapping Client Eva, Jozef PASSED (arctest), FAILED(ngtest)

CRITICAL

bug description component tester result
2301 Uploaders from WS ARC segfault while trying to upload to SRM:// URLs CE Jozef n/a
2472 Period and Time not usable with python for missing methods to get values CLIENT Jozef n/a
2474 renew credentials does not work with arc1 server CE Jozef PASSED
2487 Infosystem thrashes the contents of /var/lock/subsys/ when started INFO Florido CLOSED,PASSED
2392 Repositories for ARC 11.05 need to be created
2423 arctest can not find targets, reports bogus error CLIENT Eva, Jozef PASSED (arctest), FAILED(ngtest)
2442 ARC incompatible with CERN voms server CORE Florido n/a
2491 2.6 python bindings for RH5
2516 WARNING: Failed to create ldif generator script for infosys and iptables issue INFO Jozef PASSED

MAJOR

bug description component tester result
1887 arcstat -a very inefficient Client Gabor PASSED
1979 Configuration issues when running a split GFS / GM setup Info n/a
2266 Problem building the nordugrid-arc-1.0.0b1 tarball that was

generated in ETICS (swig compatibility)

Client Gabor FAILED, Still open with this source (http://emisoft.web.cern.ch/emisoft/dist/EMI/1/RC4/sl5/tgz/nordugrid-arc-doc-1.0.0.tar.gz)
2449 ARC 11.05 parsing voms attributes CE n/a
2452 ARClib's DownloadDirectory aborts with: globus_list_rest:

Assertion `head != 0' failed.

Client n/a
2463 argget report failure in downloading jobs from ARC0 sites Client Gabor PASSED

normal

bug description component tester result
2148 "User tools (arccp/rm/ls) should uri encode their arguments before using them"
2219 "Segmentation faults in DataStagingDelivery"
2288 "More informative errors in arcstat when a site is down" Client Gabor PASSED
2291 "No pointer to Windows, Mac packages downloads"
2365 "Job submission failed, no more possible targets however server is health"
2370 "multiple arched processes are spawned"
2388 "Logrotate and gridftp and A-REX"
2405 "gridftp dmc is not using anonymous as the default for plain ftp."
2411 "Only SLURM 2.2.1 supported, not newer version."
2418 "Repository for Ubuntu 11.04"
2420 "arcproxy manpage errors"
2425 "Timeout for user uploadable files is too long"
2427 "gm-kick is called by scan-SLURM-job but it is not installed in {$basedir}"
2429 "ldapsearch should escape parentheses"
2430 "ARC shouldn't request a gsiftp URL when it isn't configured to use one"
2431 "ARC should release the TURL after transfer failure"
2434 "No man page - nordugridmap" CE Florido PASSED
2435 "No man page - arc-infoindex-relay & arc-infoindex-server" INFO Florido VERIFIED/PASSED
2441 "Unable to configure ARC to build with external LCMAPS headers"
2445 "A-REX crashes when using WS-interface"
2453 "arcclean reporting failure at server site"
2455 "arc1 fails to compile with recent libxml2 and xmlsec"
2456 "seg fault from gridftpd when submitting job"
2458 "arcls fails to list files on dcache gridftp server"
2470 "URLs with spaces cannot be cached"
2493 "ngrm command line options descriptions differ"
2494 "jobs get stuck in EXECUTED when resumed after failing in uploading output files"
2496 "Wrong metapackage name in server installation instructions"
2499 "ARC build problems"
2407 "No check for Python.h is made in ./configure, but the python bindings are built"
2412 "Downloading fails from ARC gridftpd 0.8.1 site when using cache."
2454 "Debian and Ubuntu repo examples have testing instead of experimental"
2403 "arc.conf.template refers to arc server but is in package nordugrid-arc-client"
2461 "GGUS-Ticket-ID: #71248 EMI1: arc-ce documentation issues"
1291 "ability to use srm over https through url option"
2015 "merged standalone to contain both new and old client tools"
2076 "Distribution of binary release packages needs improvements"

Test report EMI components

Reports for the ARC Core components

Reports for the ARC Computing Element

Reports for the ARC Client components

Reports for the ARC Information System components

Reports for the ARC GridFTP server