Overheard inside the Kuiu outlet last month: Kuiu sales guy ranting to a customer about Pro/Ultra jacket users regularly calling in about repairs or durability issues, and how those items are meant for in camp or glassing ONLY, otherwise they should be inside your pack. Backpacking clothing is either "go" clothing or "stop" clothing, meaning some is active wear and some is not. Kuiu down puffies are NOT intended to be worn while hiking or backpacking. You'd be too hot anyways. They are designed exclusively for sitting and glassing etc.
That's from the Kuiu sales guy's mouth. Same general rule applies to backpacking, you don't wear puffies while hiking because they are too fragile, too warm, and you don't want moisture buildup from sweat inside a non-breathable down puffy.
If you really need a heavy warm layer for moving, go synthetic.