Solution :
I researched on it and it seems like the service needs to be enabled called the "Computer Browser"
I could not find above service in my Task Manager -> Services
.
Not in my Win+R -> services.msc
.
So I kept searching and many answers didn't help me as I knew firewall was not a issue. But it mentioned the SMB
so I searched around it and found below one:
Make sure the SMB 1.0/CIFS File Sharing Support is properly installed as the windows feature.
It seems like my later versions of Windows 10 have this feature as disabled by default. So I just enabled it and restarted my computer and now my network devices show up and net view /all
returns my computer names successfully.