hipBlastLT build failed with msgpack error even though it is installed

[jdgh000]

Using ROCm-6.0 release

pip3 list | grep -i msgpack
msgpack 1.0.8

Also did pip install -r .sphinx/requirements as instructed in the README.

./install.sh --clients
Creating project build directory in: /root/extdir/gg/git/codelab-scripts/build-install-scripts/rocm/ROCm-6.0/hipBLASLt/build
/home/rocm/ROCm-6.0/hipBLASLt /home/rocm/ROCm-6.0/hipBLASLt
/home/rocm/ROCm-6.0/hipBLASLt/build/release /home/rocm/ROCm-6.0/hipBLASLt/build/release /home/rocm/ROCm-6.0/hipBLASLt
/home/rocm/ROCm-6.0/hipBLASLt/build/release /home/rocm/ROCm-6.0/hipBLASLt
-DAMDGPU_TARGETS=all -DCMAKE_BUILD_TYPE=Release
-- The CXX compiler identification is Clang 17.0.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /opt/rocm/bin/hipcc - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Using hip-clang to build for amdgpu backend

*******************************************************************************
*------------------------------- ROCMChecks WARNING --------------------------*
  Options and properties should be set on a cmake target where possible. The
  variable 'CMAKE_CXX_FLAGS' may be set by the cmake toolchain, either by
  calling 'cmake -DCMAKE_CXX_FLAGS=" -D__HIP_HCC_COMPAT_MODE__=1"'
  or set in a toolchain file and added with
  'cmake -DCMAKE_TOOLCHAIN_FILE=<toolchain-file>'. ROCMChecks now calling:
CMake Warning at /opt/rocm/share/rocm/cmake/ROCMChecks.cmake:46 (message):
  'CMAKE_CXX_FLAGS' is set at
  /root/extdir/gg/git/codelab-scripts/build-install-scripts/rocm/ROCm-6.0/hipBLASLt/CMakeLists.txt:<line#>
  shown below:
Call Stack (most recent call first):
  CMakeLists.txt:9223372036854775807 (rocm_check_toolchain_var)
  CMakeLists.txt:130 (set)


*-----------------------------------------------------------------------------*
*******************************************************************************

-- Found Git: /usr/bin/git (found version "2.43.0")
CMake Warning (dev) at cmake/findBLIS.cmake:41 (set):
  Cannot set "BLIS_FOUND": current scope has no parent.
Call Stack (most recent call first):
  CMakeLists.txt:141 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

CMake Warning (dev) at cmake/findBLIS.cmake:42 (set):
  Cannot set "BLIS_INCLUDE_DIR": current scope has no parent.
Call Stack (most recent call first):
  CMakeLists.txt:141 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

CMake Warning (dev) at cmake/findBLIS.cmake:43 (set):
  Cannot set "BLIS_LIB": current scope has no parent.
Call Stack (most recent call first):
  CMakeLists.txt:141 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

BLIS heeader directory found: /root/extdir/gg/git/codelab-scripts/build-install-scripts/rocm/ROCm-6.0/hipBLASLt/build/deps/blis/include/blis
BLIS lib found: /root/extdir/gg/git/codelab-scripts/build-install-scripts/rocm/ROCm-6.0/hipBLASLt/build/deps/blis/lib/libblis.a
-- Performing Test COMPILER_HAS_TARGET_ID_gfx90a_xnack_on
-- Performing Test COMPILER_HAS_TARGET_ID_gfx90a_xnack_on - Success
-- Performing Test COMPILER_HAS_TARGET_ID_gfx90a_xnack_off
-- Performing Test COMPILER_HAS_TARGET_ID_gfx90a_xnack_off - Success
-- Performing Test COMPILER_HAS_TARGET_ID_gfx940
-- Performing Test COMPILER_HAS_TARGET_ID_gfx940 - Success
-- Performing Test COMPILER_HAS_TARGET_ID_gfx941
-- Performing Test COMPILER_HAS_TARGET_ID_gfx941 - Success
-- Performing Test COMPILER_HAS_TARGET_ID_gfx942
-- Performing Test COMPILER_HAS_TARGET_ID_gfx942 - Success
-- AMDGPU_TARGETS: gfx90a:xnack+;gfx90a:xnack-;gfx940;gfx941;gfx942
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- Performing Test HIP_CLANG_SUPPORTS_PARALLEL_JOBS
-- Performing Test HIP_CLANG_SUPPORTS_PARALLEL_JOBS - Success
/usr/bin/python3 -m venv /root/extdir/gg/git/codelab-scripts/build-install-scripts/rocm/ROCm-6.0/hipBLASLt/build/release/virtualenv --system-site-packages --clear
/home/rocm/ROCm-6.0/hipBLASLt/build/release/virtualenv/bin/python3 -m pip install /home/rocm/ROCm-6.0/hipBLASLt/tensilelite
Processing /home/rocm/ROCm-6.0/hipBLASLt/tensilelite
  DEPRECATION: A future pip version will change local packages to be built in-place without first copying to a temporary directory. We recommend you use --use-feature=in-tree-build to test your packages with this new behavior before it becomes the default.
   pip 21.3 will remove support for this functionality. You can find discussion regarding this at https://github.com/pypa/pip/issues/7555.
Requirement already satisfied: pyyaml in /usr/local/lib64/python3.9/site-packages (from Tensile==4.33.0) (6.0)
Requirement already satisfied: msgpack in /usr/local/lib64/python3.9/site-packages (from Tensile==4.33.0) (1.0.8)
Requirement already satisfied: joblib in /usr/local/lib/python3.9/site-packages (from Tensile==4.33.0) (1.3.2)
Using legacy 'setup.py install' for Tensile, since package 'wheel' is not installed.
Installing collected packages: Tensile
    Running setup.py install for Tensile: started
    Running setup.py install for Tensile: finished with status 'done'
Successfully installed Tensile-4.33.0
WARNING: You are using pip version 21.2.3; however, version 24.0 is available.
You should consider upgrading via the '/home/rocm/ROCm-6.0/hipBLASLt/build/release/virtualenv/bin/python3 -m pip install --upgrade pip' command.
-- Adding /home/rocm/ROCm-6.0/hipBLASLt/build/release/virtualenv to CMAKE_PREFIX_PATH
-- The C compiler identification is GNU 11.4.1
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
CMake Error at build/release/virtualenv/lib64/python3.9/site-packages/Tensile/Source/lib/CMakeLists.txt:105 (find_package):
  By not providing "Findmsgpack.cmake" in CMAKE_MODULE_PATH this project has
  asked CMake to find a package configuration file provided by "msgpack", but
  CMake did not find one.

  Could not find a package configuration file provided by "msgpack" with any
  of the following names:

    msgpackConfig.cmake
    msgpack-config.cmake

  Add the installation prefix of "msgpack" to CMAKE_PREFIX_PATH or set
  "msgpack_DIR" to a directory containing one of the above files.  If
  "msgpack" provides a separate development package or SDK, be sure it has
  been installed.

[KKyang]

Please try apt-get install -y libmsgpack-dev and reinstall the Python msgpack to see if it works.

[jdgh000]

it is redhat not ubuntu

[jichangjichang]

@jdgh000 Please try ./install.sh -d --clients

[ppanchad-amd]

@jdgh000 Has this issue been resolved for you? Thanks!

[tdavie]

I initially had the same error on Ubuntu 24.04 + rocm 6.2 with gfx908, installing libmsgpack-dev and running the script with -d to install other dependencies resolved the issue. Unsure if the manual package installation was actually necessary or would have been picked up by the script.

[jichangjichang]

I initially had the same error on Ubuntu 24.04 + rocm 6.2 with gfx908, installing libmsgpack-dev and running the script with -d to install other dependencies resolved the issue. Unsure if the manual package installation was actually necessary or would have been picked up by the script.

libmsgpack-dev installation is part of -d

hipBLASLt/install.sh

Line 175 in 182e0f5

library_dependencies_ubuntu+=("libmsgpack-dev")

[tdavie]

Great, looks like simply running -d is the complete solution then.

[jinz2014]

@ppanchad-amd

May you open the issue ?

1. The install.sh will install libmsgpack, right ? If so, then apt-get install -y libmsgpack-dev is not the solution, right ?
2. Please explain why sudo permission is needed when using install.sh

Thanks