investigating ruby build failure

Oct 20, 2023

To build ruby with the system openssl, instead of downloading and building its own copy:

RUBY_CONFIGURE_OPTS="--with-openssl-dir=$(brew --prefix [email protected])" \
  asdf install ruby latest

To find out why my build is failing, I added set -x to ~/.asdf/plugins/ruby/bin/install:

$ git diff diff --git bin/install bin/install index b3f5cea..2aa70f9 100755 --- bin/install +++ bin/install @@ -2,6 +2,10 @@ set -euo pipefail +# added by llimllib for debugging +set -x +# DELETEME + # shellcheck source=/dev/null source "$(dirname "$0")/../lib/utils.sh"

This logged the ruby-build invocation, but didn't apply to ruby-build itself. But it did show me that it ran .asdf/plugins/ruby/ruby-build/bin/ruby-build, so let's try the same trick on that

~/.asdf/plugins/ruby/ruby-build/bin/ruby-build 3.1.2 ~/.asdf/installs/ruby/3.1.2

ruby-build sources ~/.asdf/plugins/ruby/ruby-build/share/ruby-build/3.1.2, which has two commands:

install_package "openssl-3.0.5" "https://www.openssl.org/source/openssl-3.0.5.tar.gz#aa7d8d9bef71ad6525c55ba11e5f4397889ce49c2c9349dcea6d3e4f0b024a7a" openssl --if needs_openssl_102_300 install_package "ruby-3.1.2" "https://cache.ruby-lang.org/pub/ruby/3.1/ruby-3.1.2.tar.gz#61843112389f02b735428b53bb64cf988ad9fb81858b8248e22e57336f24a83e" ldflags_dirs enable_shared standard verify_openssl

the first doesn't execute because I gave it a proper openssl already. The second ends up calling:

build_package ruby-3.1.2 ldflags_dirs enable_shared standard verify_openssl # which then calls build_package_ldflags_dirs ruby-3.1.2

Then the trail goes cold after set - $LDFLAGS - I have no idea what that is supposed to be doing! I added a set -x after it to see if that changes anything?

That ultimately calls this make command that is failing:

++ make -j 8 BASERUBY = /usr/bin/ruby --disable=gems CC = clang LD = clang LDSHARED = clang -dynamiclib CFLAGS = -fdeclspec -O3 -fno-fast-math -ggdb3 -Wall -Wextra -Wdeprecated-declarations -Wdivision-by-zero -Wimplicit-function-declaration -Wimplicit-int -Wmisleading-indentation -Wpointer-arith -Wshorten-64-to-32 -Wwrite-strings -Wold-style-definition -Wmissing-noreturn -Wno-cast-function-type -Wno-constant-logical-operand -Wno-long-long -Wno-missing-field-initializers -Wno-overlength-strings -Wno-parentheses-equality -Wno-self-assign -Wno-tautological-compare -Wno-unused-parameter -Wno-unused-value -Wunused-variable -Wextra-tokens -Wundef -std=gnu99 -fno-common -pipe XCFLAGS = -D_FORTIFY_SOURCE=2 -fstack-protector-strong -fno-strict-overflow -fvisibility=hidden -DRUBY_EXPORT -I. -I.ext/include/arm64-darwin21 -I./include -I. -I./enc/unicode/13.0.0 CPPFLAGS = -I/Users/llimllib/.asdf/installs/ruby/3.1.2/include -D_XOPEN_SOURCE -D_DARWIN_C_SOURCE -D_DARWIN_UNLIMITED_SELECT -D_REENTRANT DLDFLAGS = -L/Users/llimllib/.asdf/installs/ruby/3.1.2/lib -Wl,-multiply_defined,suppress -install_name /Users/llimllib/.asdf/installs/ruby/3.1.2/lib/libruby.3.1.dylib -compatibility_version 3.1 -current_version 3.1.2 -fstack-protector-strong -framework CoreFoundation -fstack-protector-strong -framework CoreFoundation SOLIBS = -lpthread -ldl -lobjc LANG = en_US.UTF-8 LC_ALL = LC_CTYPE = MFLAGS = - --jobserver-fds=6,7 -j

oh man is it this stupid? mkdir -p ~/.asdf/installs/ruby/3.1.2/{bin,lib,include}

idea via this comment

alright if you do that before trying asdf install it doesn't work, because asdf then believes it already has version 3.1.2, so I added it to the ruby build script - now I get a new failure at least.

--- ruby-build/bin/ruby-build	2022-10-18 11:14:28.000000000 -0400
+++ ruby-build/bin/ruby-build.bak	2022-10-18 11:19:11.000000000 -0400
@@ -582,12 +582,6 @@
       use_homebrew_gmp || true
   fi

-  # llimllib
-  echo "------------->"
-  set -x
-  # DELETEME
-  mkdir -p ~/.asdf/installs/ruby/3.1.2/{bin,lib,include}
-
   ( if [ "${CFLAGS+defined}" ] || [ "${!PACKAGE_CFLAGS+defined}" ]; then
       export CFLAGS="$CFLAGS ${!PACKAGE_CFLAGS}"
     fi

now we have:

858 │ compiling addr2line.c 859 │ compiling dmyenc.c 860 │ make: ./config.status: Permission denied 861 │ make: *** [ruby-runner.h] Error 1 862 │ make: *** Waiting for unfinished jobs....

ok to find those compiling messages, I had to find common.mk, which seems to have some more makefile stuff in it. That file indicates that there is a V option, which if set to 1, will cause it to log verbosely:

# V=0 quiet, V=1 verbose. other values don't work. V = 0

To set that, I just jimmied the make command to add V=1 because I didn't figure out how to add it to the argument array properly, and who cares:

# llimllib: remove V=1 when done debugging { "$MAKE" "${!PACKAGE_MAKE_OPTS_ARRAY}" $MAKE_OPTS V=1 ${!PACKAGE_MAKE_OPTS}

ok, the miniruby command that failed now shows up!

./miniruby -I./lib -I. -I.ext/common ./tool/generic_erb.rb -o builtin_binary.inc \ ./template/builtin_binary.inc.tmpl -- --cross=no

sadly, when I cd into the directory and run it myself, it succeeds:

$ ./miniruby -I./lib -I. -I.ext/common ./tool/generic_erb.rb -o builtin_binary.inc \ ./template/builtin_binary.inc.tmpl -- --cross=no builtin_binary.inc updated

urgggg just going into the dir and doing make install works. Very frustrating!

ok, now asdf wrote over my version of ruby-build. So let's clone ruby-build, and work on it in its own dir:

$ RUBY_CONFIGURE_OPTS="--with-openssl-dir=$(brew --prefix openssl@3)" bin/ruby-build 3.1.2 /tmp/wut ... omitted compiling yjit.c make: /opt/homebrew/bin/gmkdir: Permission denied make: *** [coroutine/arm64/.time] Error 1 make: *** Waiting for unfinished jobs....

ok let's try adding V=1 again. Here's the patch I applied:

diff --git bin/ruby-build bin/ruby-build index 517bc15..d45c4ba 100755 --- bin/ruby-build +++ bin/ruby-build @@ -568,6 +568,13 @@ build_package_standard_build() { MAKE_OPTS="-j $(num_cpu_cores)" fi + if [ "${VERBOSE+defined}" ]; then + echo "adding V=1" + MAKE_OPTS="V=1" + else + exit 1 + fi +

f*$&, it worked this time! cmon man I need you to fail here.

And now... it just succeeds with asdf, no changes required. That sucks.

↑ up