/usr/bin/ld: final link failed: Bad value

An attempt to compile certain libraries that rely on packages fetched by apt end up with /usr/bin/ld: final link failed: Bad value error.

It can be easily demonstrated on ffi gem if libffi is fetched by apt.

Steps to reproduce:

Create new heroku app with cedar-14 stack
Create new Rails 4.2 app
Set https://github.com/ddollar/heroku-buildpack-multi as buildpack on heroku
Add ffi gem to Gemfile
Replace sqlite3 with pg to maintain compatibility with heroku
Bundle gems
Create .buildpacks with two buildpacks: https://github.com/ddollar/heroku-buildpack-apt, https://github.com/heroku/heroku-buildpack-ruby
Add any library that relies on libffi to the Aptfile, e.g. libgirepository-1.0-1 and libgirepository1.0-dev
Push the app to heroku
See how the build fails

Log:

Test app:

ddollar / heroku-buildpack-apt