The seat belt bolts can be quite difficult to remove sometimes for some reason. All of mine came out easily, except for the passenger's shoulder harness. It took a lot of work to get it removed.
That combined with a cheap torx bit could be your problem. Cheap ones don't fit well (leading to stripped bolts), and they twist and break easily.