If the board or the connector is damaged you can buy as much different SD cards with no success.
I don’t believe that ardupilot and or the Matek FCs will only run on special SD cards.
If you have board failure you will have it with all software.
But it is possible that with some software or function the failure not show up. The problem is that you cannot be sure that it under all conditions will not come up.
If you have an internal shortcut on one part this can destroy over the time other parts of the controller or completely the controller.
If you follow the recommandations of MATEK why you want to use a 64G SD card if only 4GB is useable with FAT32. So If the problem is comming from a wrong SD card type use the simplesd working solution.
But the communication between the controller and the SD card is controlled by the firmware. And the ardupilot firmware is not from MATEK. So if Ardupilot is using also other filesystems as FAT32 you can use this also with MATEK HW. Only the routing off the signal path through the board can have some influence and will limit signal speed.
What you can do is to measure the signals between the controller and the SD card port. But therefore minimum an oszilloscope and a logic analyzer is needed.
Many user here are using MATEK SLIM V3 boards but only yours shows this problems with the SD card. If this is a general problem we would read here more about it.
This gives me the oppionion that you have a individual problem with either some setting of the port or with the HW itself. So maybe you can open a claim to your supplier if the board is a very new one.