@Jon Hurtt
It's my fist attempt at setting up 802.1X and at the moment I am only testing. I've got no other switch where this is working, only an ERS5530-24TFD with the same problem.
The SNAS 4050 is no real UNIX, it's a Nortel proprietary operating system. Therefore the guide you've linked won't help me a lot. But I've used a lot of other Nortel/Avaya Guides (e.g. ERS 45xx Security Config Guide / NSNAS Solution Guide / NSNA Technical Configuration). Maybe I will try next week setting up a RADIUS Server with FreeRadius, if I get no solution until then.
@ Flintstone
As far as I know Ignition is the replacement product for the SNAS 4050, which had End of Sale in 2010. One problem with the MAC based solution is that you have to manage the MAC adresses by hand (?). But in my opinion the bigger problem is, that you don't have real security. These days it's no problem to change a MAC of a device, keyword MAC-Spoofing. That's the reason why I prefer a certificate based solution.
edit: i forget - I try this with both VLANs on the specified port and 'untagPvidOnly', but now after the succesful authentication both VLANs will remove from the port
Thank you for your help again!