This is my favorite acoustic album I think Altan are always unplugged. You can hear the real acoustic bass and it sounds great. The late great Bob Crump of TG Audio recommended this one to me and he was right as always.
This is my second favorite. Muddy Waters unplugged is more in keeping with the tone of the original post.
Richard Thompson’s 1000 Years of Popular Music would fit what you are looking for, and it has a version of Brittany Spears’ “Oops I Did It Again” which is remarkable. I have the CD set and also have that song on a vinyl 45 with St. Vincent Black Lightning on the other side.
Cannot recommend this too highly. Previously only available as a 2 CD special edition with the original re-master this acoustic version is now being sold individually. It is brilliant, reveals whole new ideas from the originals. Paddy McAloon is a songwriting genius in my book.
A nod to Jeff Tweedy: Together at Last which is almost wholly acoustic solo versions from the Wilco catalogue. Not every track really flies but some are great.
Clayhill - Small Circle (acoustic version) is wonderful. The talents of Gavin Clark (RIP), Ted Barnes & Ali Friend were on display with this alternative version of Small Circle. All their albums are worth hearing.