Today I was reading about dynamical systems and I've realized that some activation functions for neural networks, such as the logistic function [0], are also chaotic maps [1]. Is this just a coincidence or is there an advantage if an activation function is a chaotic map?
[0] https://en.wikipedia.org/wiki/Logistic_function
[1] https://en.wikipedia.org/wiki/Logistic_map