I do have a Kuiu puffy vest that I've found I wear more often. I think they are pretty similar except the Kuiu is more "puffy". I wear it around town quite a bit and under my shell.
I am seriously considering this, but like you, having a hard time with when and how I'd use it. I also have a puffy.......maybe under the Koldo jacket when I am in a treestand during November/ December.
Let me think about it some more and get back to you.