Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 4 years ago.
Improve this question
I am trying to get a list of singles released in 2018 from allmusic.com.
It is easy enough to go to their advanced search page and input those parameters, but then I would have to copy and paste the information by hand. All the information is in the html, but it has be generated by clicking the search button and the page navigation buttons. The url itself doesn't change. That puts it well out of my ability to crawl via my limited beautiful soup skills.
Does anyone know how to web crawl java script generated html?
Without looking into the details of the particular website, I imagine you would need to find out what HTTP requests the JS code is making and work backwards from there.
Start by inspecting the network calls (e.g. in Chrome DevTools, just look in the Network tab) and then write something to make those same calls to retrieve the data.
Related
Closed. This question needs details or clarity. It is not currently accepting answers.
Want to improve this question? Add details and clarify the problem by editing this post.
Closed 2 years ago.
Improve this question
I'm rendering one PDF in my website using the Canvas so that the user can view but not download. I have disabled the right click and the disable the download button and disable the printout too on any of the browsers. However there are still ways to get into the F12 mode and get the PDF downloaded. IF any one can help to achieve my logic to disable the developer mode on that particular webpage.
Thanks in advance.
Even if you could, it won't matter.
The pdf document data, unless generated by your client, has been downloaded, which means even if a website had control over a client's dev tools (which it does not), the client could just intercept all the packages containing your file going to his machine.
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 6 years ago.
Improve this question
I'm making a (web) app for a school project, using Phonegap. I'm writing IT in Javascript, HTML and CSS, and I am very new to coding.
My question seems to me to be pretty straightforward, but I can't seem to find any solution on the internet.
I have finished my homepage, but now I need a button which directs you to another page (the menu), from where you can go to other pages within the app. But I just can't find out how to make different pages, and how to direct users to those pages.
There are two ways I see you can do this. Either make a new program (new HTML file) and make the button redirect you to that or completely clear the page using document.write("") and rebuild it.
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 6 years ago.
Improve this question
I tried using java script but it didn't work. I also tried php imagegrabscreen() but it demands URL whereas I have a customer's page URL different for everyone ex: /member.php?email=shady#gmail.com&code=A101_123 .
Basically I want to store user's screenshot so he can be able to see those images of his activity. So any solution?
I would recomment to take a look at html2canvas. It is a JavaScript solution that works on the client side. Only problem: It takes the current DOM from the user and builds a picture with the browser engine. So it is not 100% accurate, but pretty close.
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 6 years ago.
Improve this question
I have been searching across the Web to find a solution to this:
Basically what I want to setup is a way to have an HTML page on a live production site to kept updated. This is because I have setup a SilverStripe Application as part of a graphics system (green chroma key) that runs through normal HTML.
AJAX load doesn't seem to be an option here since the load would be every 1 second or half a second to make sure the page is live.
I looked into web socket quite vaguely but the whole concept of integrating it with my project confused me entirely.
Anyone got any ideas of what could be done?
To do this you'll need a combination of:
AJAX, you'll need to never do a full page load after the initial Web 1.0 request.
Session history management, you'll need this in order to not break the browser navigation (e.g. back/forward buttons).
Web Sockets, you'll need this so when new content arrives on the server it is received by the client without first having to poll the server.
Web sockets will be the greatest challenge. I listed them in the order in which you should approach the project, in three phases.
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 9 years ago.
Improve this question
Imagine a website - for example YouTube. In every video I'd like to insert a link next to the title that will point to my website, and if I click it, it grabs the url and sends it to my site's database.
I've seen somewhere such a possibility (I don't remember where), consisted of the fact that you dragged a *.js file onto your browser window and it worked locally just for you in the browser like an extension to existing site or sth.
Can you point me to articles or other resources if this is possible?
You have a couple options:
You can use a browser extension such as Greasemonkey for Firefox, or Tampermonkey for Chrome.
Write a Bookmarklet.