Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 3 years ago.
Improve this question
I have to display more than 50k rows with data. Using pure angularjs main problem will be speed and data caching. Can you advise a library or direction that is solution to my problem?
Do not "ever" display so many items at once to a user.
If you find your self in a need to display so much information, something is wrong with the way you have thought about how your users will interact with the application.
A couple of things to look into should be :
Paging the data ( filters & pages, much like any e-shop for example )
Use the correct HTTP response headers to allow browsers to cache requests, on the other hand you can even try to cache queries on the server, instead of hitting the database every with every request
Now caching data is a trade off between "data time updates & performance across the platform". Some times the data must be "live" so you can not really add any caching logic, but most of the times you can get away with "x minutes old data", 2,3,5 minutes, depending on what you want to achieve, that will greatly improve performance for the platform, both for the users experience, as well as for the system's stability
Related
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 4 days ago.
Improve this question
I was asked to rework our canteen's website to be more user-friendly to operate for the chef and other staff, who are unfamiliar with coding and content management systems. More specifically, we have a menu page where the meals for the next 3 weeks are displayed, and I was asked to make it easier to update said page.
I figured that the simplest approach would be to create a spreadsheet in Google Sheets or Excel and to pull the data - so the names of meals and some dates - into the HTML page from there, so that whenever the staff needs to update the information, they can just edit the spreadsheet instead of bothering with the backend of the website.
My first approach was to try and connect the HTML to a Google Sheet using Google Apps Script, but this proved difficult since I don't actually know any JavaScript and expected the whole ordeal to be simpler.
I tried following some tutorials I found online, but they a) were mostly for extracting entire tables, not just singular pieces of data and b) they didn't work. I thought about using an actual database program in the hopes that would help, but I don't have access to Microsoft Access at the moment.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 5 months ago.
Improve this question
I would like to publish a website that hosts menus for different restaurant branches.
What would be good way to do publish this?
Bearing in mind occasional price changes - does this mean taking the website down and re-deploying or is there a way I can dynamically update item prices?
Hosting providers/CMS tools appreciated
I have written the website using basic html/css/js so far.. I have only used django to host a website on the local loopback address. I am determined to learn more.
The first question would be can you access the price data online? (Other websites?)
If you are able, to get the data online then you could create a database and small program which fetches the required data for the website. You can then give that a refreshing rate of 5 min or what ever you like.
Then give your website to access the database and load the prices/data from the database into your website.
If you do not have the data online you can still use a database for storing the prices and other data. If you store the data in database you can load it from the database into your website.
To update the data you can either insert the values directly into the database or you can write an webinterface. (Do not forget to restrict the access to the webinterface)
For the communication I would recommend to use CRUD methods ( Create Read Update Delete) https://en.wikipedia.org/wiki/Create,_read,_update_and_delete
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 1 year ago.
Improve this question
I'm trying to make a website where a user can look through an image gallery of books, each accompanied by the book's name and other properties, such as reading level, number of pages, etc.
I'd be using my own images of the books and entering the data for them myself, but I'm not sure how to store these book objects. I obviously don't want to manually make a <div> for each and enter all the data, but rather use JS to access the list of all the books and their data and output them.
I'm not sure what would be the appropriate method of storing these books. Would I make a SQL database, use localStorage, or something else entirely?
I am sure you do not want memory and performance to be a concern when you design something.
Refer this to know more about localstorage limitations.
I would suggest you go with a database and store it there, will be a scalable option as well. I am assuming you have a crud operation also involved in your website.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 8 years ago.
Improve this question
There is a website which contains information we have paid for access to, however the only way available to access the information is through the website and there are 1400 records. So, since there is so much of it, we want to have the information in an excel spreadsheet which is manageable. However, the organization in charge of the website isn't willing to help.
I can write a python script that can parse the html and extract the relevant data, however, the problem is that the site is not easily crawlable because it is an ASP site and many of the "links" are in fact triggers to javascript which loads the destination page. This means that a tool like HTTrack doesn't really work.
Are there any other tools or python modules which can help me do this (bearing in mind the "javascript" links)? I'm totally new to this kind of thing, so I just have no experience of what kinds of things are available to me.
Jython + HtmlUnit may be very usefull in your task.
You can use Scrapy, which is a framework for scraping websites.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 8 years ago.
Improve this question
I'm looking for a good way of monitoring and logging full exchange between website and the internet.
I know that this can be done with firebug. The main problem I have with it is, that it cannot persist log data over reloads.
Also, if would be very cool to have an ability to log javascript activity and filter the log by the action I'd like to debug (e.g. setting a cookie, change of attribute etc)
Does anyone know something that fits at least some of those requirements, and on the rest performs at least as well as firebug does?
You might want to check out one of the many JavaScript logging utilities, like log4js. You could use it and or something like PantomJS to build automated testing / monitoring of your web applications. The discussion around JavaScript logging on StackOverflow is pretty good too. Check out these questions:
https://stackoverflow.com/questions/1423267/are-there-any-logging-frameworks-for-javascript
A JavaScript frontend logging system that logs to our backend?
You could try fiddler: http://www.fiddler2.com/fiddler2/