`cargo vendor` does not include license-file if not in package list

[zbraniecki]

Describe the problem you are trying to solve

Mono-repos usually have a single LICENSE file in the top directory and they reference it from all crates via some license-file = "../../LICENSE".

At the moment, cargo will not package file from such path.

Since the license file needs to be packaged into the crate for it to be able to be vendored in into other projects.

We encountered that problem when trying to vendor in ICU4X (rust mono repo) into Firefox.

In order to comply with the vendor policy of Mozilla, we need to duplicate the LICENSE file to each component of the mono repo and introduce a maintenance script to ensure the licenses stay in sync.

See the issue, and the PR.

Describe the solution you'd like

It would help such projects if files referenced in Cargo.toml were packaged even if they live in the parent directory to the crate root.

The file could be copied to the root directory of the package.

Notes

If that's impossible, I'd at least suggest displaying a warning that cargo skips packaging of the file.

[ehuss]

Can you maybe clarify with an example? The license-file should be packaged:

[package]
name = "foo"
version = "0.1.0"
edition = "2018"
license-file = "../../LICENSE-MIT"

> cargo package
warning: manifest has no description, documentation, homepage or repository.
See https://doc.rust-lang.org/cargo/reference/manifest.html#package-metadata for more info.
   Packaging foo v0.1.0 (/Users/eric/Proj/rust/cargo/scratch/foo)
   Verifying foo v0.1.0 (/Users/eric/Proj/rust/cargo/scratch/foo)
   Compiling foo v0.1.0 (/Users/eric/Proj/rust/cargo/scratch/foo/target/package/foo-0.1.0)
    Finished dev [unoptimized + debuginfo] target(s) in 0.76s
> tar -tzf target/package/foo-0.1.0.crate
foo-0.1.0/Cargo.lock
foo-0.1.0/Cargo.toml
foo-0.1.0/Cargo.toml.orig
foo-0.1.0/LICENSE-MIT
foo-0.1.0/src/main.rs

[zbraniecki]

@dminor should be able to!

[dminor]

Yes, sorry, you're quite right, packaging is working just fine, I'm just not seeing the license file after running cargo vendor.

I'm testing with the icu_locid crate, 0.2.0. I've pulled down the package directly and verified the LICENSE file is present in what is on crates.io.

Do we need to do something different with the package configuration for cargo vendor to work in this situation?

[ehuss]

Nah, it's just an issue with cargo vendor.

It may be tricky to fix, since cargo package needs to handle rewriting the path to be relative to the package, and the package listing code just returns a simple list of paths, with the assumption they are all inside the package root. If anyone wants to dig into it, the cargo package code is here, and the vendoring code is here. However, cargo package uses the same list_files() function, so just adding the license-file there will probably cause problems (and, list_files assumes all returned paths are relative to the package root).

[zbraniecki]

Could it be solved with includes pointing at the file LICENSE.txt that in the package is in the root? From the vendor perspective there's no difference if the file was originally in the root dir before packaging, or some super-root, right?

[ehuss]

If you mean, could icu_locid add either ../../LICENSE.txt or /LICENSE.txt to include, I think neither will work (since it doesn't allow outside paths, and the file doesn't exist in the root of the package). I can't think of any easy workarounds, unfortunately.

[zbraniecki]

Ah, so maybe I don't understand how cargo vendor work. I thought it operates based on packaged zip file in which LICENSE.txt is in the root, but now that I reason about it, it also can vendor in from git URL in which case i'd have to find ../../LICENSE in the Cargo.toml and navigate its way to it, right?

[ehuss]

Yea. It starts with the packaged zip file, but then uses the include list to drive what to copy. This was mainly added to support git dependencies. There's more history about why it does it at alexcrichton/cargo-vendor#137, alexcrichton/cargo-vendor#139. Another option would be to maybe have cargo vendor only use list_files for git dependencies? One could say you still want the LICENSE file for git dependencies, too, though.

[Manishearth]

Yea. It starts with the packaged zip file, but then uses the include list to drive what to copy

Perhaps we can explicitly include the LICENSE key? It seems pretty important to not drop that.

[ehuss]

Yea, that would probably be the best fix. As mentioned above, there are some links there if someone is interested into digging into it. I'm a little uncomfortable duplicating that logic in multiple places, but it can't be put directly into list_files due to relative paths. It is not obvious to me how to structure that in a clean fashion.