[DOCA] compile xlio with doca #147
Open
+509
−257
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
vialogi
force-pushed
the
HPCINFRA-1968_doca_compilation
branch
2 times, most recently
from
3dbd4ee
to
1a87fd0
Compare
|
Please target the PR to doca_xlio branch. It is currently the doca branch. |
vialogi
force-pushed
the
HPCINFRA-1968_doca_compilation
branch
2 times, most recently
from
a290b4c
to
345a478
Compare
vialogi
force-pushed
the
HPCINFRA-1968_doca_compilation
branch
22 times, most recently
from
6f56292
to
0f64702
Compare
vialogi
force-pushed
the
HPCINFRA-1968_doca_compilation
branch
2 times, most recently
from
6e8c303
to
85bfca5
Compare
dpressle
requested changes
Jul 11, 2024
vialogi
force-pushed
the
HPCINFRA-1968_doca_compilation
branch
3 times, most recently
from
41eb3ea
to
e778c8e
Compare
Migrate test processes from static bare metal server to k8s dynamic containers on ub22.04 Issue: HPCINFRA-2196 Signed-off-by: Daniel Pressler <danielpr@nvidia.com>
vialogi
force-pushed
the
HPCINFRA-1968_doca_compilation
branch
from
e778c8e
to
14a17c3
Compare
dpressle
requested changes
Jul 15, 2024
vialogi
force-pushed
the
HPCINFRA-1968_doca_compilation
branch
from
14a17c3
to
67cdc6e
Compare
dpressle
requested changes
Jul 15, 2024
vialogi
force-pushed
the
HPCINFRA-1968_doca_compilation
branch
4 times, most recently
from
f260b78
to
43508ee
Compare
dpressle
changed the title
…upport DOCA requires some extra packages from specific repo to make compilation possible In this commit we're: - determine the platform we're running on - adding DOCA packages repo in container image - installing dependencies - setting up swx-jenkins user which have access to DOCA repo in Gerrit Issue: HPCINFRA-1968 Signed-off-by: Viacheslav Login <vlogin@nvidia.com>
vialogi
force-pushed
the
HPCINFRA-1968_doca_compilation
branch
3 times, most recently
from
8677af0
to
d83bf87
Compare
We're requested to provide DOCA libs and binaries compiled and installed prior to XLIO compilation. We're going to enable DOCA compilation the same way we do for DPCP compilation: by adding do_compile_doca() function in globals.sh do_compile_doca() does the following: - checks out DOCA SDK source code - prepares the environment - compilation & installation - returns DOCA installation path so it can be used as "--with-doca" parameter for XLIO DOCA/DPCP compilation is not required in static tests containers (cppcheck, csbuild). COMPILE_DOCA and COMPILE_DPCP variables have been added to control this contrib/test_jenkins.sh was updated to check COMPILE_DOCA and COMPILE_DPCP vars and to call compile_doca() and do_check_dpcp() if true Issue: HPCINFRA-1968 Signed-off-by: Viacheslav Login <vlogin@nvidia.com>
- mounting hugetlbfs from host machine to solve "EAL: FATAL: Cannot get hugepage information" - checking available 2MB hugepages - applying patch from Alex Grissik, solving the "Multiprocess is not supported" in DOCA (DPDK) - fixing platform typo in config/m4/doca.m4 Issue: HPCINFRA-1968 Signed-off-by: Viacheslav Login <vlogin@nvidia.com>
… IP / default GW Many Gtest failures were caused by inability of XLIO to determine remote IP / default GW in containerized environment. This was caused, in its turn, by early log messages, that were posted to stdout during XLIO initialization The fix, applied by this commit redirects XLIO early log message from stdout to stderr (printf() -> fprintf() in vlogger.cpp), which allows XLIO to determine default GW correctly Issue: HPCINFRA-1968 Signed-off-by: Viacheslav Login <vlogin@nvidia.com>
Some Gtest test cases fail at the moment, in particular: - test cases, that are related to "send to socket id" actions - tests that are related to fork(), which is not supported by DOCA - test cases, related to remote ip / default GW problem, that is temporary workarounded by redirecting XLIO messages from STDOUT to STDERR Issue: HPCINFRA-1968 Signed-off-by: Viacheslav Login <vlogin@nvidia.com>
Gtest step is disabled until Oct'24 release, Jira HPCINFRA-1968, RM #3981627, #3981654 Issue: HPCINFRA-1968 Signed-off-by: Viacheslav Login <vlogin@nvidia.com>
We're running compiler.sh in Ubuntu22.04, where there is a problem using module files, created for RHEL/CentOS For now, to make things working we install all the required compilers inside container: - Install all required compilers inside comtainer rather than connecting modules - Use update-alternatives to switch between compilers - Update matrix_job.yaml with toolbox target for docker build Issue: HPCINFRA-1968 Signed-off-by: Viacheslav Login <vlogin@nvidia.com>
- Remove 3 attempts loop - Make sure the do_archive call takes place and not being skipped Issue: HPCINFRA-1968 Signed-off-by: Viacheslav Login <vlogin@nvidia.com>
vialogi
force-pushed
the
HPCINFRA-1968_doca_compilation
branch
from
d83bf87
to
0b5923e
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
We add DOCA compilation to CI
What
Prepare containers for DOCA compilation, checkout DOCA SDK and do compilation
Why ?
PR# 138 performs basic DOCA operations, so it is possible that when more DOCA functionality is added to XLIO, other DOCA compilation issues will arise.
How ?
Change type
What kind of change does this PR introduce?
Check list