This error is created mostly on a CentOs / similar linux operating systems with SELinux On.
By default SELinux does not allow you to listen on non standard http ports such as 8983 in which SOLR listens on. To fix this run the following command as root:
semanage port -a -t http_port_t -p tcp 8983
This adds the 8983 port to http list. This should solve the Permission denied message when querying SOLR.
Restart SOLR / Applications.
This should solve Failed to query Solr using '*:*': [Errno 13] Permission denied