As long as the stone around the fireplace isn’t taking on heat, you can choose whatever stone you prefer. Granite is popular because it is more resistant to heat than quartz, although quartz has been growing in popularity from an aesthetic perspective.