getting started with web scraping [closed] - javascript

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 3 years ago.
Improve this question
First I want you to know that I'm quite new with html and css, and at the moment I don't know how to use Java Script. I was watching videos on how to make a web scraper and I have some questions:
I see a lot of tutorials doing web scraping in python and since I quite know python I was asking myself, what is better for web scraping? Python or Java Script, which should I use? Can I 'connect' a python program with html?
I need to use web scraping for a web site, I'm trying doing something that takes specific dats from other web site and then display them on my web site, so people can see them. Do you have any suggestion on how to get started?
Please notice that I'm not too good in english, there are no tutorials or video for web scraping in my language and excuse for the error in this post.

Python can be used for web scraping, a popular choice is to use Beautiful Soup but usually you will need to use a few packages to do more complex things as you are describing.
Here is a nice tutorial that should help you get started:
https://www.dataquest.io/blog/web-scraping-tutorial-python/
In terms of the website you mention, you would need to create some kind of webapp using Flask/Django that will either populate a database with the information you are scraping or that will retrieve the information on request by a user of your website.
For the Javascript vs Python I am not sure as I have only used python. My experience has been very good with it but the following might give you more information: What is the best language and tool for doing web scraping?
, I wrote a web scraper in four different languages.
The following blog post might also be useful to you: Building a Web Scraper from start to finish
(Disclosure: I haven't read this fully, only scanned it but it seems relevant to your question)

Related

Can we use python with react? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 3 years ago.
The community reviewed whether to reopen this question 1 year ago and left it closed:
Original close reason(s) were not resolved
Improve this question
I have seen many people are using Nodejs with reactjs but I liked python and react so much that I wanted to know if I could python with react. If so could you please give me some links for learning that please
I have experience building web applications using React and Python Flask together, so perhaps I can help.
I do not know of a way to directly use Python on client-side web applications, but there are certainly plenty of ways to use Python on the backend. The most popular Python web frameworks are Flask and Django.
If so could you please give me some links for learning that please
YouTuber Corey Schafer has a great YouTube tutorial series on Flask, which I would wholeheartedly recommend.
Once you get more comfortable with web development in Python, I think the website https://realpython.com/ has great tutorials for both specific questions (e.g. Token-Based Authentication in Flask) and more general tutorials.
If you go with Django, it has a great ORM built in for working with databases.
If you go with Flask, which is definitely more beginner friendly IMO, I would recommend Peewee ORM for working with relational databases unless you have more complicated use-cases, in which case SQLAlchemy is the de-facto standard.
Good luck learning!
Update
I just came across this cool Python library called Transcrypt that transpiles Python code into JavaScript, so it turns out you can write client-side code for the web in Python. Their website has some cool tutorials.
Yes. React is mostly agnostic of what's going on at the server-level.
ie it does not care what backend you use.
Check this example : https://realpython.com/the-ultimate-flask-front-end/
https://plotly.com/dash
I have been using this to build up react app with python.
They have new libs 'dash' and dash component whose underlying is react.js.
React is backend-agnostic.
React manages the UI, which possibly interacts with some HTTP APIs regardless in what language they're made of.
What's important is that your API use some standard like REST, jsonapi or GraphQL so you can benefit a wide range of tools (documentation, tests...)
That said, if you want to make "server-side-rendered" react web apps, like Next.js does, or if you need WebSockets, you'll need NodeJS on the server-side too. Also, the ability to use the same code, tooling and ecosystem on the client and the server is useful for a developer.

WordPress for java developer, is this possible? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 3 years ago.
Improve this question
I am a Java developer and I know Rest APIs. But what if I want to make great webpages using website building tools like WordPress and then with Rest API I can connect with my backend server.
Will that be a viable solution or I should look for something else?
On a very basic research I got to know that wordpress runs on PHP, but I am not looking to learn PHP at this point of time.
I am looking for the below things :
1 - Some tool which helps in building rich HTML page, that has drag
and drop options.
2 - I am thinking to use Spring boot for
configuring Rest API.
Basically I am looking for some suggestions in building good websites having knowledge of Java. (And yes I still need to learn Ajax and Javascript.)
I might be absolutely wrong on what I am looking, but any suggestion will be of great help.
A REST client (in your case a website) doesn't care what programming languages/technologies were used to create the server. You can have a server hosting a WordPress website (PHP) and have another server for your REST API created in Java or whatever other language you might want to use. If you want to make REST calls from your WordPress server (e.g. for server-side rendering), you'll need to use PHP. The more likely scenario is that the website makes REST requests from the browser, in which case you'll need to use JavaScript.

How can I check how many visitors are visiting my website? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 7 years ago.
Improve this question
I've a software developer having done most of my work in older technology stacks, and recently mobile iOS development. However I really know nothing about web other than a bit of HTML and interacting with web API's.
I recently purchased an out of the box template website to serve as a launching page for an application of mine. I would like to find out how many people are visiting my landing page. What's the best way to do this? Just go out and find some javascript applet that will do this for me? Where is the data/running-count stored? Or should my hosting provider (namecheap) provide this information to me automatically?
Install some sort of analytics script. A good one is Google analytics.
Its common for webhosting providers to have some sort of analytics engine running like awstats or webanalyzer.
Also you could create a free account in Google Analytics and follow the instruction to add a snippet of code to your page to count your visits.
Now if you also want to show a visit counter, the best alternative is to make it with some server side code and a database (or a file). It is relatively easy and if you post your server infrastructure (php, asp, mysql,postgres, etc) i could expand this answer with more help.

Looking for Documentation Pointers/Tutorials For Adding Javascript To Django application [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 8 years ago.
Improve this question
I would appreciate documentation and/or tutorial links to help me with the following.
I maintain a traditional web application, implemented in html, javascript, and Perl. The web site uses a third-party open source library that implements buttons. If you wave the mouse over the buttons, they indent and put up a tool tip. The site looks very professional.
I've implemented a very simplistic Django application. It does the job, but uses hyperlinks. I'd like to dress up my Django application, and make it look more professional `a la the traditional web site.
I tried this before with some simple javascript, checking fields to see if they contained a valid answer, and this did not work. As it was explained to me, it had to do with the server side processing.
Given there is no javascript already, I have no problem using a different library (JQuery) than my traditional web site.
I have no problem if someone thinks implement in html, javascript, and php, because I've got one of those applications, too. However, I'd like to continue with Django, if possible.
Javascript and Django are independent. I use Django with jQuery UI to get nice buttons but you could use any javascript library, including the one you are using in the original site.
Your existing site is either using hyperlinks, the same as Django, that are modified in the browser to be buttons (this is what jQuery UI can do as well). This is the simple case you just need to put your javascript in the templates.
If it is a complete ajax application you'll need to write Django web services to handle those.
Your best bet is to find a tutorial for the particular javascript library you are using because Django is pretty much javascript agnostic. For instance the jQuery getting started page is a good place to start.

Looking for some great example web applications to learn real-world development techniques [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 8 years ago.
Improve this question
I've done a bunch of web development with JSP/J2EE and some ASP.NET. Nevertheless, I still feel like I'm catching up with the web 2.0 stuff that relies heavily on JavaScript.
I have two questions:
I'm looking for great samples of web applications to learn development techniques. I prefer to look at real-world examples (i.e. something open source). I'm open to learning from any great code, regardless of language used on server side. The kind of example webapps I'm looking for are ones that clean and not too complex, but also not too trivial. I have checked out some code from google code project hosting, but I don't have time to download and look at hundreds of different projects, so I'm looking for suggestions.
Second question: I know Ruby on Rails was an innovative framework (which I've never used, but I'm familiar with it and I've played around with Grails, a similar framework but more Java-like). So rails is now a few years old. What are the major things we learned since the introduction of Rails and what does the next generation of web framework look like?
I knew that saving this tweet from Ruby News would come in handy.
Take a look at Chris Lowis's post: Open-source rails apps to study and learn from.
about the first question, I can suggest you TeamBox, very similar to Basecamp, but it's open source, with an avaiable repository on github. it's written in rails.
for the second question: for sure I learnt about MVC approach (I re-applied same philosophy to PHP in some works). the next generation frameworks are using even more abstractions and layers. for example using ORM libraries for different databases (you save time writing SQL queries, you can use same API for different databases, even for the new NoSQL storages).
I suggest you to look for Redis, CouchDB and MongoDB databases. they are different each other about approach and data-organization, but they are becoming very useful for complicated web-apps

Categories

Resources