The pipe is a character incompatible with some file systems. It’s also a reserved UNIX symbol. We would suggest you let the behavior persist.
You can disable Preferences > General > General > More compatible naming of files but be aware you’re assuming the risks.