Kurt burning all of his Bukowski books remind me of what Jimi Hendrix did at Monterey '67. While reading this thread through, I was surprised that noone come up with this suggestion. I take Kurt's action to be in the very same league. Jimi loved to play guitar and loved that particular instrument as well and as we know, he played guitars well after the incident - it was merely not an act of departure from playing guitar but for the average eye what else it could mean? According to him, the whole act served as a cleansing from the subject of his idolization/passion and what this instrument meant for him in order to be able to renew the connections established between them years before this event and elevate it to another level (can't remember source now). In this sense, Kurt's confession in my view should be read just like that and I have a feeling he got the idea clearly being inspired by these actions of Jimi and similarly made such an event out of it concerning his subject of idolization. The expression, "Kill Your Idol" is based on this very same notion but that would take us much farther from here...
On the other hand, Axl was indeed a big fan of Bukowski. Mick Wall gave several Bukowski books to him during 1989 when he was interviewing him and according to Axl, as stated in the book, he was consuming them as quickly as possible. You can read on all this in Mick Wall's book concerning GN'R, "The World Most Dangerous RN'R Band".