I have investigated this further and I found out that saving meta_box data only does not work for builtin taxonomies: so for post_tags and categories.
If I register a custom taxonomy, everything works as it should.
Any ideas why meta fields for builtin taxonomies do not save? and the update_term_meta never triggers for them, while it triggers fine for a custom taxonomy.