Find all files (not including hidden files) that are not directories, shuffle them randomly, select the first one, and delete it.
find . ! -name '.*' ! -type d -print0 | xargs -0 shuf | head -n1 | xargs rm