When your table has more than 1 field with relations to sys_category you will run into problems because the MM relation table sys_category_record_mm will only store which table a category belongs to - but not the specific field.
You need to extend sys_category_record_mm like this:
Add the following to your extension's ext_tables.sql:
CREATE TABLE sys_category_record_mm (