There isn't a single "default" material library. You can delete the native material libraries from Programm Data but I expect SketchUp might throw errors on startup. When I start SketchUp, it goes to the last library I had open. If it's one of my custom libraries, it goes to that one.
T