Skip to content

index.md

Latest commit

 

History

History
280 lines (222 loc) · 17.3 KB

index.md

File metadata and controls

280 lines (222 loc) · 17.3 KB
layout default

Alma Common Software Community Branch RPM Repos for CentOS 7 (EL 7)

For now, only x86_64 is available, but, hopefully once the SRPMS are made available ports can be created for aarch64, without cross compiling nightmares =D. Versions 2016.10+ have a beta-working ExtProd RPM and repo with an ACS RPM in alfa. Version is number-guided to keep clear the update order for the rpm package.

Current Status: 28/9/2017

  • ACS-2017.06 (Jun) has a good number of changes with 2017.04.
  • ACS-ExtProds uses castor package without acs-patches.
  • 15/5/2017: Patch is for castor 0.9.6, and most of it is already included, with different names in the code, however, I can't build xmljbind due to the missing method "setDefaultURIResolver(AlmaURIResolver)" added in the patch -> Patch Needs Updating
  • 18/5/2017: Created Castor-ACS-0.9.6.2017.02. Only xmljbind makes direct use of it. Leavind ACS-ExtProds as it was. Patch Update is STILL Needed if castor is to be used.
  • 30/5/2017: Created log4cpp-ACS, devel package used by ACS-logging
  • Updated to 2017.06
  • ACS-ExtJars is OK (Updated to 2017.06)
  • ACS-eclipse-plugins is built with Autoreq = no, otherwise, it has never ending java dependencies. (Updated to 2017.06)
  • ACS-ToolsKit no longer build benchmarks, which needs to be build after all the acs-core packages.
  • Added AutoReq no. (Updated to 2017.06)

  • ACS-jACSutil Compilation is OK, Unittests Passed 12/15 (Updating to 2017.06)

  • ACS-xmljbind: Compilation is OK, Unittests Passed 1. 1 Broken (diska)

  • ACS-xmlpybind Compilation is OK, Unittests, 1 Passed, 2 Failed, 3 broken

  • ACS-acserridl OK

  • ACS-acsidlcommon OK

  • ACS-acsutil OK, Tat Test require baciidl

  • ACS-acsstartup under construction

  • ACS-loggingidl is OK

  • ACS-logging is OK, Tat Test require maciidl

  • ACS-acserr is OK, Unittests Failed

  • ACS-maciidl under construction, needs acserrType

  • ACS-baciidl OK , Tat Test require maciidl

  • tcltk-ACS created. Compiles tcltk with ACS patch, leaving products in /home/acs-tcltk/tcltk. In the future, products will be left in /usr/local. In the meanwhile, is where ACS-Extprod will call tcltk

  • ACS-acserrTypes is OK.

  • Tat Tests:

grepFile doesn't exist - sedFile doesn't exist: Extend temporary rpm path to Kit/acs/src (not bin, intentionally) /diska/home/almadev/introot/idl/.xml: No such file or directory Some tests don't compile

  • False Failures:

ERROR: ----> ../lib/libbaselogging.a does not exist. (It does) ERROR: ----> ../lib/libacserrHandlersErrStubs.a does not exist. (It does) ERROR: ----> ../lib/libbaciErrTypePropertyStubs.a does not exist. (It does. baciidl)

  • Deprecation Warnings:

warning: ThreadInfoCompositeData is internal proprietary API and may be removed in a future release (jacsutil) Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details Note: ./alma/ACSErrTypeCppNative/wrappers/AcsJCppAnyEx.java uses or overrides a deprecated API (acserrTypes) Note: ./alma/ACSErrTICS/wrappers/AcsJAnyTICSErrorEx.java uses or overrides a deprecated API. (acserrTypes)

  • Usual compilation issues in packages:

Missing argument for option: -XSL | Update paths of xalan.jar in acserrGen scripts : commit 32f1ac415da730 fatal error: acserr.idl: No such file or directory | acserr not in global path : commit 73f733b No rule to make target acserrExceptionManager.h | Usually needs to symlink that header with the ones in commit 3868fc0

  • The same applies to logging.h, commit 1528c5d, acsutilTimeStamp.h commit d416ce0, loki stuff commit 03de50d, acsutil.h commit ff045c0
  • Non Fatal Errors

/idl/baciErrTypeProperty.xml: src-resolve: Cannot resolve the name 'common:nameType' to a(n) 'type definition' component

Dependencies by language

Highlighted the ones with the least dependencies

  • c++

    • acsthread (logging, acserrTypes)
    • repeatGuard (acsutil, acsThread | outputs repeatGuard.jar)
    • cdb (cdbidl ACSErrTypes acscomponentidl logging expat(tool) ) - C++ CDB Deprecated
    • acsalarm (acsThread logging loki ACE maciidl acsalarmidl acsutil expat cdbidl acserrTypes cdb) - creates AlSysSource
    • acscomponent (acscomponentidl acserrTypes acsThread)
    • recovery (loki logging)
    • basenc (acsncidl acscommonidl baciidl acscomponentidl acserridl acserr acsutil cdb acserrTypes recovery)
    • archiveevents (acsnc acsncidl basenc cdb)
    • parameter (loki logging xerces-c (tool)
    • baci (baciidl acsThread acserrTypes acsalarm acsutil cdb logging acscomponent recovery acserr baciidl archiveevents TAO pattern(?) )
    • enumprop (baciidl)
    • maci (maciidl acscontainer acscomponent ACE-TAO logging acsutil baselogging(?) loki acserr acserridl acserrTypes acsalarm acsqos archiveevents)
    • acslog (acserr maci logging acsutil TAO)
    • acstestcompcpp ( acscomponentidl baciidl acserridl baci logging acsThread archiveevents | Produces jar outputs, needs ExtJars)

  • java (check .classpath inside component folder for dependencies)

    • acsjlog (jdt maci maciidl JacORB cdbDAL acserr cdbidl acslog acscommon ExtJars jdom.jar(?) xercesImpl.jar acserrTypes loggingidl acsASsources.jar | outputs slf4j-api, replace with system's if available)
    • jacsutil2 ( repeatGuard.jar acsjlog jacsutil maciidl loggingidl acserrTypes acserr cdbidl castor (normal or castor-ACS?) )
    • cdbChecker
    • codegen
    • cdb_rdb (commons-cli-1.2.jar (ExtJars) )
    • acscallbacks
    • jacsalarm
    • jmanager
    • jlogEngine (JacORB ExtJars abeansR2Components.jar jacsutil maciidl icons.jar(?) xercesImpl.jar loggingidl acscommon acserr acsjlog jacsutil2)
    • comphelpgen (xmljbind xercesImpl ExtJars xmlParserAPIs.jar castor* acscomponent )
    • jcont (java container: JacORB slf4j* castor* ExtJars xmljbind acsjlog define baci cdbidl acscomponent maci/idl jacsutil acserrTypes lc.jar(?) acserr ArchiveIdentifierError.jar acsASsources.jar jacsalarm acscontainer jacsutil2 )
    • jcontnc( JacORB jcont acscomponent cdbidl acserr acserrTypes acsnc/idl acscommon jacsutil maciidl acstime acsexmp castor* repeatGuard ExtJars define)
    • jacsalarmtest ( acsASsources.jar cdb/idl ExtJars acserrTypes acsjlog maci/idl jcont acscontainer acserr)
    • jbaci (baciidl)
    • acscommandcenter

  • python/bash

    • acspycommon ( acscommonidl?)
    • acsalarmpy (acsalarmidl?)
    • acspy
    • acspyexmpl

  • 2/3 languages

    • loggingts ( ?/java: | acsjlog maci/idl cdbidl castor* jacsutil JacORB acsASsources.jar acserrTypes acserr lc*.jar acscontainer loggingidl acsCallbackSupport.jar)
    • acsstartup
    • loggingtsTypes (c++/java: | acsnc acscontainer ExtJars )
    • acsContainerServices (c++/java: acserrTypes acsThread acsComponent)
    • task (c++/java: baciidl xerces-c(tool) ACE-TAO(tool) maci loki logging baselogging acserr acserridl)
    • acstime (all: baci maciidl )
    • acsnc (c++/java: acsutil logging pthread acserrTypes acsncidl repeatGuard acstime maci/idl basenc TAO)
    • acsdaemon (c++/java: logging ACE-TAO acscomponent maciidl acsutil acserrTypes acsqos acsalarm acserr acsThread loki acsdaemonidl | acserrj jacsutil acserrTypes acscomponent maciidl acscontainer acsjlog JacORB cdbidl acserr acscommon )
    • acsexmpl (c++/java: | acserr maci acserrTypes junit(ExtJars) lc.jar (?) acsjlog jacsutil JacORB)
    • define (c++/java: acscommonidl acscomponentidl | xmljbind xercesImpl)
    • acsentities (define xmljbind castor* xercesImpl ExtJars)
    • nsStatisticsService (c++/java: acscomponentidl | ExtJars)
    • jcontexmpl (c++/java)
    • monitoring (monicd, monblobber, moncollect, moncontroller)
    • acssamp (c++/java: acsutil cdb logging acscomponent baci/idl maci/idl acsnc TAO acserrTypes | jcont jacsutil jcontnc maci/idl acsnc/idl acserr acscommon castor* cdb acserrTypes repeatGuard ExtJars )
    • mastercomp (c++/java : baciidl acserrTypes | jbaci jcont baciidl acserr maci acsjlog JacORB ... )
    • nctest
    • acssim
    • containerTests (contHandleTest, contLogTest, contNcTest, contThreadTest, corbaRefPersistenceTest, lifecycleTest)
    • acscourse
    • ACSLaser (19 subprojects/folders)
    • acsGUIs (13 subprojects)
    • acsExtras (acsXmlFileStore. c++/java:)

Building Rules

The instalation destination of the compiled products of the main rpm package of each acs component is /usr/local, where:

  • /usr/local/bin has the products in the acs component /bin directory
  • /usr/local/share/java has the jar products in the acs component /lib directory
  • /usr/local/lib64/ has the shared objets (.so) products in the acs component /lib directory
  • /usr/local/lib/python/site-packages has the python products in the acs component /lib directory

Some packages generates elements in /object folder, such as Skeleton, Stubs and/or static libraries (.a files). Those elements are packaged in the devel rpm and are also installed in /usr/local, where:

  • /usr/local/include has the .h, .cpp and .inl files originated in the acs component /object directory
  • /usr/local/lib64/ has the static linked (.a) products in the acs component /lib directory

Other products, such as man pages and documentation should also be in their respective /usr/local path.

The Source0 element for each acs component rpm package consists in the complete git repository of ACSCB, which is, the result of the merges explained below. The main contents of Source0, the LGPL folder is available with the acs-cb-ToolKit-devel rpm package.

The main idea applied in each package is to:

  • Replace the use of .bash_profile.acs declarations with several separated files in /etc/profile.d, ensuring the loading of them on boot time
  • Inside each SPEC file, make calls acsMakefile, encapsulating the results inside the rpm without big modifications of the way it works.
  • Each acs rpm package replaces the list of packages to be compiled with the package's name, in order to trick acsMakefile to only compile the single acs component at a time.

Once an rpm package is succesfully manually built, it undergoes a "strict" build under Jenkins CI, where env vars and other elements are deleted, creating a clean building environment. Lastly, each package can be tested in centos docker containers.

Currently, the main focus is to succesfully compile and package the acs components, with tat tests compiling but being allowed to temporary fail. Once the first iteration is concluded, tat tests will be fixed where necesary, considering that some tat test dependencies are different than those of the main acs component package.

Use Instructions

  • Update OS

yum -y update

  • Apache-maven-fedora repo must be installed before:

curl https://repos.fedorapeople.org/repos/dchen/apache-maven/epel-apache-maven.repo -o /etc/yum.repos.d/epel-apache-maven.repo

  • Epel and centos-release-scl Repos

yum -y install epel-release centos-release-scl

  • Install ACS CB and ExtProd Repo

curl http://repo.csrg.cl/acs-cb.repo -o /etc/yum.repos.d/acs-cb.repo

  • Install ACS CB ExtProds and ACS CB Extra Jars

yum install -y ACS-ExtProds ACS-ExtJars

After the instalation of ACS-ExtProds, and before de ACS instalation, a session logout-login is needed in order to load the environment variables (now in profile.d files)

Places to look for packages:

In order to save time, the lookup of existing RPMs in other flavors of RPM using S.O. is highly recommended.

Also http://www.rpmfind.net and OpenSuse pages are useful.

How was this ACS built

We have a forked ACS Community Branch git which is regularly been merged against ALMA ACS's git repository. This is what Source0 of each acs component package contains.

The main idea behind the RPMs is the use of system-available packages, which will in return allow an easier instalation/management of ACS

ExtProd is in a Beta state and ACS Core in an alfa state for 2016.10. 2017.02 hasn't been released. The SPEC files can be found at this github

Initially ExtProd was built as a regular RPM with the check-rpaths commented out in .rpmmacros file. It happened because Eclipse has [https://fedoraproject.org/wiki/RPath_Packaging_Draft](libs in non-system paths). This appears no longer needed. Also AutoReq is set to "no"

The only packages not being from a RPM origin inside ExtProd are JacORB and Mico. Tcltk has a first version of its own package. Mico is expected to fail on RHEL 6, so this behaviour is expected also on EL/RHEL 7+, although it appears to build correctly, and includes the latest gcc6 patch.

As many ACS building/compiling needed-scripts are been left as Sources of the ExtProd RPM, also to allow modularity in their updates. This scripts are left in system default path's such as /usr/local/bin, in order to prevent the need for path extension and modifications on the user side.

Another important point is the intend to deprecate the use of .bash_profile.acs file, leaving enviroment variables in /etc/profile.d files. For example, ExtProd RPM creates jacorb.sh, which contains and exports:

JACORB_HOME=/home/almamgr/ACS-%{version}/JacORB export JACORB_HOME

Source0 in Extprod RPM consist in the following:

ACS-ExtProd-{ACS_Version}

  • INSTALL
    • buildEclipse
  • PRODUCTS
    • eclipse-SDK-4.2.2-linux-gtk-x86_64.tar.gz
    • eclipse-4.2.2-delta-pack.zip

The traditional files from the old instalation of ACS are kept as legacy but not used. All of this can be installed via the acs-cb-ToolKit-devel rpm, which is available from 2016.10+. ExtProds RPM creates user almamgr with uid 550 and the /alma symlink, which point to /home/almamgr.

Of the Tools Module built by ACS the yet not RPM encapsulated are (getopt ignored as is indicated for SunOS only):

tat xsddoc extidl vtd-xml oAW scxml_apache

Package selection in ExtProd

All of the python packages in acs.req and acs.req.0 have been included as requirements of the rpm or installed through pip. Every package is kept as closed as possible to the one indicated in acs.req/acs.req.0 files, with the consideration that if a newer version is available, and the changelog indicates no mayor changes, then the newer version will be prefered. Also, if the version in the acs.req files is deprecated, the oldest system available version is prefered. Python 2.7 is not being compiled as it comes with CentOS 7.

As CentOS 7 is compatible with mainly every package between fedora21 and fedora24, and further for packages not involving gcc, the srpms are fetch and recompiled, allowing an interesting number of versions per package to be selected. Also RPMs from OpenSUSE and other rpm based SO is considered. The spirit of the RPM is initally to replace with system available packages as much as possible and the fix whatever may have been broken.

ACE-TAO Extra Patch

The following replacement/patch has been aplied to ACE-TAO 6.3.0_{ACS_Version}

sed -i 's/IOP::TaggedComponentList create_ior_components/IOP::TaggedComponentSeq create_ior_components/g' /usr/include/orbsvcs/SecurityReplaceable.idl

For information about this change, please see 2008a Changelog of TAO: Removed TaggedComponentList and use TaggedComponentSeq, thefirst one is not part of the CORBA spec, the second is.

Docker Containers

In order to create re-usable building and testing environments, there are a couple of available docker containers

  • 2016.10 : Container with ACS 2016.10 hand compiled. Created to compare/analize expected behaviour.
  • The container where ACS is been built can be found at https://hub.docker.com/r/csrg/acs_builder/
  • 2017.06 in production.

FAQ, Other Repositories and Useful Links

To-Do List

Deprecated Packages used in ACS