[docs] quant_kwargs

[stevhliu]

Improves where you can find the quant_kwargs in the PipelineQuantizationConfig docs

[sayakpaul]

Thanks! Do we have to include an explicit point on how users can derive qaunt_kwargs for a given backend?

[asomoza]

I'm undecided as to what is best, to include each quantization backend here as @sayakpaul mentioned or to an index of them like you did, so I'll leave it to you.

Also I wanted to see the final docs but the doc builder failed.

[stevhliu]

I think it's probably best to refer the user to the specific API docs for each backend where they can find all the relevant arguments, and keep this one more high-level.

Not sure why the doc-builder is failing though. bitsandbytes should already be installed in the CI test environment no? 🤔

[sayakpaul]

I think it's probably best to refer the user to the specific API docs for each backend where they can find all the relevant arguments, and keep this one more high-level.

Yeah indeed. I was asking for an explicit note that says just that.

[sayakpaul]

Not sure why the doc-builder is failing though. bitsandbytes should already be installed in the CI test environment no? 🤔

No actually. bitsandbytes is not a required dependency in our CI and we install it only when running the quantization tests.

I opened #11728 for this. Let's see.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[asomoza]

in line 94 there's a link to 'simple quantization' so this will break it, change the other link then?

[asomoza]

saw this too late I think

[stevhliu]

Oops, should be fixed in #12018!