Missing or corrupt Library Files on the Target Instance caused the libgcc_s.so: undefined reference to `__stack_chk_fail@GLIBC_2.4' error.

Per Oracle Support Doc ID: 761566.1
Missing or corrupt Library Files on the Target Instance caused the libgcc_s.so: undefined reference to `__stack_chk_fail@GLIBC_2.4′ error.
This error indicated that a bad library file was linked into the 10.1.2 & 10.1.3 IAS Oracle Homes.
SOLUTION

  1. Check what RPMs are installed on the Source and Target machines by running the following command on each machine:
    As Root:

$ rpm -qa –qf ‘%{name}-%{version}-%{release}.%{arch}\n’|egrep ‘binutils|compat|elfutils|gcc|glibc|libaio|libgcc|libstdc|make|openmotif|libXp’|grep -v automake|grep -v avahi|grep -v elfutils|sort > WHAT_RPMS_SOURCE.txt
$ rpm -qa –qf ‘%{name}-%{version}-%{release}.%{arch}\n’|egrep ‘binutils|compat|elfutils|gcc|glibc|libaio|libgcc|libstdc|make|openmotif|libXp’|grep -v automake|grep -v avahi|grep -v elfutils|sort > WHAT_RPMS_TARGET.txt

  1. Examine both files to see the difference.
  1. Install all the latest RPMs from the Oracle Mirror Site for Linux 6 kernel version:
    http://mirrors.psu.ac.th/oraclelinux/repo/OracleLinux/OL6/UEKR3/latest/x86_64/
    > Search down for:
    — 3.8.13-44.1.1.el6uek.x86_64
  1. Then use Note 761566.1– Oracle E-Business Suite Installation and Upgrade Notes Release 12 (12.1.1) for Linux x86-64

***  ALTHOUGH INSTANCE IS 12.1.3  — SAME STEPS APPLY.. Specific Steps below must be carried out:
Update AS 10g (10.1.2 and 10.1.3) Oracle Homes (Oracle Linux 6, RHEL 6, Oracle Linux 7 and RHEL 7 only)
After installation, users must update the stub libraries in the 10.1.2 and 10.1.3 Oracle Homes using Patch 12415211.  In following the instructions below, please note that Opatch should not be used to install this patch.
Users must specifically copy the files in the patch to the specified directories as follows for the 10.1.2 Oracle Home:
$ cd <12 .1_install_dir=””>/apps/tech_st/10.1.2/lib
$ cp -p -R stubs stubsORIG
$ cd stubs
$ cp /12415211/files/lib/stubs/libgcc_s-2.3.2-stub.so .
$ ln -s libgcc_s-2.3.2-stub.so libgcc_s.so.1
$ ln -s libgcc_s.so.1 libgcc_s.so
After this is done and sourcing the APPS.env file, users should relink all 10.1.2 executables by running the $ORACLE_HOME/appsutil/clone/adlnktools.sh script and ensuring that there are now no errors in the make log file output from the script.
The instructions for the 10.1.3 Oracle Home are:
$ cd <12 .1_install_dir=””>/apps/tech_st/10.1.3/lib
$ cp -p -R stubs stubsORIG
$ cd stubs
$ cp /12415211/files/lib/stubs/libgcc_s-2.3.2-stub.so .
$ ln -s libgcc_s-2.3.2-stub.so libgcc_s.so.1
$ ln -s libgcc_s.so.1 libgcc_s.so
Here is the direct quote from the Support Doc ID – includes addressing other issues.

INSTALLING OR UPGRADING

Perform the installation or upgrade following the documentation (Oracle E-Business Suite Installation Guide: Using Rapid Install, Oracle E-Business Suite Upgrade Guide: Release 11i to Release 12.1.1 or Oracle E-Business Suite Release 12.1.1 Maintenance Pack instructions) relevant to the specific installation or upgrade scenario described above.

AFTER INSTALLING OR UPGRADING

Perform the following steps after installing or upgrading to Release 12.1.1 and before allowing users to access the system.

Update AS 10g (10.1.2 and 10.1.3) Oracle Homes (Oracle Linux 6, RHEL 6, Oracle Linux 7 and RHEL 7 only)

After installation, users must update the stub libraries in the 10.1.2 and 10.1.3 Oracle Homes using the patch 12415211. In following the instructions below, please note that Opatch should not be used to install this patch.

Users must specifically copy the files in the patch to the specified directories as follows for the 10.1.2 Oracle Home:

$ cd <12.1_INSTALL_DIR>/apps/tech_st/10.1.2/lib
$ cp -p -R stubs stubsORIG
$ cd stubs
$ cp <PATCH_INSTALL_DIR>/12415211/files/lib/stubs/libgcc_s-2.3.2-stub.so .
$ ln -s libgcc_s-2.3.2-stub.so libgcc_s.so.1
$ ln -s libgcc_s.so.1 libgcc_s.so

After this is done and sourcing the APPS<CONTEXT_NAME>.env file, users should relink all 10.1.2 executables by running the $ORACLE_HOME/appsutil/clone/adlnktools.sh script and ensuring that there are now no errors in the make log file output from the script.

The instructions for the 10.1.3 Oracle Home are:

$ cd <12.1_INSTALL_DIR>/apps/tech_st/10.1.3/lib
$ cp -p -R stubs stubsORIG
$ cd stubs
$ cp <PATCH_INSTALL_DIR>/12415211/files/lib/stubs/libgcc_s-2.3.2-stub.so .
$ ln -s libgcc_s-2.3.2-stub.so libgcc_s.so.1
$ ln -s libgcc_s.so.1 libgcc_s.so

After this, users should relink sqlplus by running the <INSTALL_DIR>/apps/tech_st/10.1.3/appsutil/clone/adlnkweboh.sh script and ensuring that there are now no errors in the make log file output from the script.

Upgrade Oracle Database and Oracle Application Server (Oracle Linux 6, RHEL 6, Oracle Linux 7, RHEL 7 and SLES 11 only)

Customers installing E-Business Suite 12.1.1 on the above operating systems using Rapid Install must upgrade the Oracle Database to 11gR2 (11.2.0.3 or higher for OL/RHEL 6 and SLES 11, 11.2.0.4 or higher for OL/RHEL 7) or 12c (12.1.0.1 or higher for OL/RHEL 6 and SLES 11, 12.1.0.2 or higher for OL/RHEL 7) and the Oracle Application Server 10gR3 to 10.1.3.5 after installing EBS 12.1 using the respective documents:

 

Note: Customers upgrading to Oracle Database 12c on the above OSes must first apply the 12.1.3 (RUP 3) patch on their 12.1 environments prior to upgrading their Database following the Interoperability Notes above.

Customers who are cloning an existing EBS environment to a new OL/RHEL 6, OL/RHEL 7 or SLES 11 system must upgrade these technology components prior to performing the clone (as noted above).

Upgrade Java

Customers installing EBS 12.1 (using Rapid Install) should upgrade Java after the installation following the document:

Upgrade E-Business Suite, apply E-Business Suite patches (Oracle Linux 7 and RHEL 7 only)

Customers installing EBS 12.1.1 on the above operating systems using Rapid Install must do the following after the installation:

Apply AS 10g Forms/Reports Patch 13579719 (SLES 11 only)

Apply the patch 13579719 to resolve an issue with relinking Oracle Reports.

Manually fix database dbf file for Fresh production (PROD) database installs

For older versions of the startCD prior to the current version 12.1.1.13 (see Oracle Applications Release Notes, Release 12.1.1 My Oracle Support Document 798258.1), you must run the following sql commands to fix a particular corrupted dbf file if installing the production (PROD) database:

$ sqlplus/nolog
sql> connect / as sysdba
sql> alter database datafile '[full path of system09.dbf]' resize 1000M;
sql> alter database datafile '[full path of system09.dbf]' resize 1500M;

This step does not need to be run if Rapid Install was run with the current version of the startCD (12.1.1.13 or higher).

Upgrade Value Chain Planning (Advanced Supply Chain Planning) to latest Patch level (for Oracle Linux/RHEL 7 only)

Customers of Value Chain Planning (Advanced Supply Chain Planning) must upgrade to version 12.1.3.9.2 (R12.SCP_PF.B.delta.4) or higher on the above operating systems – refer to My Oracle Support Document 746824.1 for more information.

Relink Advanced Supply Chain Planning executables (for SLES 10 and 11, Oracle Linux/RHEL 5.4 or higher, Oracle Linux/RHEL 6 and 7 only)

During the relink phase of the installation of EBS Release 12 (12.1.1) on the above operating systems, failures will result while relinking the Advanced Supply Chain Planning (ASCP) executables MSO, MSC, MSR and FEM. To fix this problem, users are required to replace the following line under the Linux section of the $AD_TOP/bin/adrelinknew.sh:

CPP_LDFLAGS=' -L$(ORACLE_HOME)/lib -L$(ORACLE_HOME)/lib/stubs -lclntsh'

with

CPP_LDFLAGS=' -L$(ORACLE_HOME)/lib -L$(ORACLE_HOME)/lib/stubs -lclntsh -Wl,--noinhibit-exec'

After making this change, users are then required to run the adadmin utility and relink application executables.

Additional Information: The application of an EBS Release Update Pack (RUP) or AD family pack could over-write the adrelinknew.sh file – users must then re-edit and make changes to the above file in order to avoid relinking failures.

LD_LIBRARY_PATH Environment Variable

Dynamic libraries are used as part of the relinking and execution processes. The LD_LIBRARY_PATH environment variable is used by Oracle E-Business Suite to locate the required dynamic libraries at runtime – this variable is set by the Rapid Install wizard during the installation of EBS as well as by the Rapid Clone script (adcfgclone) when configuring the target system.

If you need to change these values, use the Edit Parameters function of the OAM AutoConfig tool (by logging in as ‘System Administrator’ responsibility, clicking on ‘System Administrator’, selecting ‘AutoConfig’ under ‘Oracle Applications Manager’, and clicking on the ‘Environments’ tab):

On each application tier server node:

LD_LIBRARY_PATH is set in three places:

  • $APPL_TOP/admin/adovars.env
  • $ORA_CONFIG_HOME/10.1.2/[CONTEXT_NAME].env, in the 10.1.2 Oracle home directory
  • $ORA_CONFIG_HOME/10.1.3/[CONTEXT_NAME].env, in the 10.1.3 Oracle home directory

In the AutoConfig interface, this corresponds to:

Location Parameter
adovars LD_LIBRARY_PATH
tools_home (10.1.2) LD_LIBRARY_PATH
web_home (10.1.3) LD_LIBRARY_PATH

On the database server node:

LD_LIBRARY_PATH is set in $ORACLE_HOME/[CONTEXT_NAME].env which corresponds in the AutoConfig interface to:

Location Parameter
db_home LD_LIBRARY_PATH

After making these changes, run AutoConfig (adautocfg.sh) to implement the changes on the application and database tiers.

Additional Information: See AutoConfig in Oracle E-Business Suite Maintenance Utilities for more information on AutoConfig.

Net Service Listeners in Multi-user Installations

Net Service Listeners use the /var/tmp.oracle directory to store temporary files. To give all users in a multi-user installation write privileges, update /var/tmp/.oracle with 777 permissions:

$ chmod 777 /var/tmp/.oracle

KNOWN ISSUES

The following are known issues for this release.

Advanced Supply Chain Planning product (MSO) may crash when increasing number of threads for optimization

The 64-bit Oracle Advanced Supply Chain Planning executable MSONWL64.exe may crash when increasing the number of threads for optimization on a system with insufficient memory (bug 7259631). The following error is observed when this occurs:

**** glibc detected *** MSONWL64.exe: corrupted double-linked list:
    0x00002aaaac0008b0 ****

Patching Application Server Oracle Homes using OPatch (Oracle Linux 6 and RHEL 6 only)

After an installation or clone of Release 12, you will need to set the OPATCH_PLATFORM_ID to ‘226’ prior to applying patches to the 10.1.2 or 10.1.3 Application Server Oracle Homes. For example, in the “ksh” shell:

$ OPATCH_PLATFORM_ID=226; export OPATCH_PLATFORM_ID

This step is needed to avoid an OPatch Config Assistant failure.

Leave a Comment

Scroll to Top