I researched on it and it seems like the service needs to be enabled called the "Computer Browser"
I could not find above service in my
Task Manager -> Services.
Not in my Win+R ->
So I kept searching and many answers didn't help me as I knew firewall was not a issue. But it mentioned the
SMB so I searched around it and found below one:
Make sure the SMB 1.0/CIFS File Sharing Support is properly installed as the windows feature.
It seems like my later versions of Windows 10 have this feature as disabled by default. So I just enabled it and restarted my computer and now my network devices show up and
net view /all returns my computer names successfully.