You need worry indeed mate, Any foriegn bodies of this size certainly needs some attention.
The only metal fragments not to worry about are extremly small filings.
The ones you have pictured are too large not to worry about. Get the gearbox out and check every bearing and syncro.