data Archives - Petamind https://petaminds.com/tag/data/ A.I, Data and Software Engineering Tue, 05 Oct 2021 06:08:53 +0000 en-US hourly 1 https://wordpress.org/?v=6.9.4 https://petaminds.com/wp-content/uploads/2019/09/ic_launcher.png data Archives - Petamind https://petaminds.com/tag/data/ 32 32 Dealing with missing data https://petaminds.com/dealing-with-missing-data/ https://petaminds.com/dealing-with-missing-data/#respond Fri, 11 Jun 2021 21:15:01 +0000 https://petaminds.com/?p=2925 In real-world data, there are some instances where a particular element is absent because of various reasons, such as corrupt data, failure to load the information, or incomplete extraction. Handling the missing values is one of the greatest challenges faced by analysts because making the right decision on how to handle it generates robust data models. Let […]

The post Dealing with missing data appeared first on Petamind.

]]> https://petaminds.com/dealing-with-missing-data/feed/ 0 Generate data on the fly – Keras data generator https://petaminds.com/generate-data-on-the-fly-keras-data-generator/ https://petaminds.com/generate-data-on-the-fly-keras-data-generator/#respond Fri, 31 Jan 2020 23:13:05 +0000 https://petaminds.com/?p=1906 Previously, we train our model using the pre-generated dataset, for example, in the recommender system or recurrent neural network. In this article, we will demonstrate using a generator to produce data on the fly for training a model. Keras Data Generator with Sequence There are a couple of ways to create a data generator. However, […]

The post Generate data on the fly – Keras data generator appeared first on Petamind.

]]> https://petaminds.com/generate-data-on-the-fly-keras-data-generator/feed/ 0 Recurrent neural network – predict monthly milk production https://petaminds.com/recurrent-neural-network-predict-monthly-milk-production/ https://petaminds.com/recurrent-neural-network-predict-monthly-milk-production/#respond Thu, 28 Nov 2019 20:50:24 +0000 https://petaminds.com/?p=1904 In part 1, we introduced a simple RNN for time-series data. To continue, this article applies a deep version of RNN on a real dataset to predict monthly milk production. The data Monthly milk production: pounds per cow. Jan 1962 – Dec 1975. You can download the data using this link. Download: CSV file The […]

The post Recurrent neural network – predict monthly milk production appeared first on Petamind.

]]> https://petaminds.com/recurrent-neural-network-predict-monthly-milk-production/feed/ 0 A really Cool data visualization: 3d globe in 2d space https://petaminds.com/a-really-cool-data-visualization-3d-globe-in-2d-space/ https://petaminds.com/a-really-cool-data-visualization-3d-globe-in-2d-space/#comments Mon, 11 Nov 2019 00:43:30 +0000 https://petaminds.com/?p=1752 While generating data in 3d space for manifold learning, I went across a problem of distributing points evenly on a sphere. It is a non-trivial problem but found a good enough solution for such placement. Interestingly, it ends up with a really cool animation effect when I decided to implement it on a mobile app. […]

The post A really Cool data visualization: 3d globe in 2d space appeared first on Petamind.

]]> https://petaminds.com/a-really-cool-data-visualization-3d-globe-in-2d-space/feed/ 1 TF2.0 Warm-up exercises (forked from @chipHuyen Repo) https://petaminds.com/tf2-0-warm-up-exercises-forked-from-chiphuyen-repo/ https://petaminds.com/tf2-0-warm-up-exercises-forked-from-chiphuyen-repo/#comments Fri, 08 Nov 2019 01:54:24 +0000 https://petaminds.com/?p=1681 Heard of Ms @huyen chip for her notable yet controversial travelling books back in the day. I enjoy reading but I am not really into travel memoirs. Nevertheless, she did surprise everyone by her achievements by getting in Stanford, teaching TensorFlow, and then became a computer/data scientist. Her story is definitely very inspiring. For ones who […]

The post TF2.0 Warm-up exercises (forked from @chipHuyen Repo) appeared first on Petamind.

]]> https://petaminds.com/tf2-0-warm-up-exercises-forked-from-chiphuyen-repo/feed/ 4 Data Visualization – Charts with Matplotlib https://petaminds.com/data-visualization-matplotlib-python-chart/ https://petaminds.com/data-visualization-matplotlib-python-chart/#respond Thu, 07 Nov 2019 03:41:09 +0000 https://petaminds.com/?p=1738 A common use for notebooks is data visualization using charts. It is easy with several charting tools available as Python imports. This article covers some common charts using matplotlib. Matplotlib Matplotlib is the most common charting package, see its documentation for details, and its examples for inspiration. Charting

The post Data Visualization – Charts with Matplotlib appeared first on Petamind.

]]> https://petaminds.com/data-visualization-matplotlib-python-chart/feed/ 0 New TensorFlow 2.0 vs 1.X – Quick note https://petaminds.com/new-tensorflow-2-0-vs-1-x-quick-note/ https://petaminds.com/new-tensorflow-2-0-vs-1-x-quick-note/#respond Thu, 10 Oct 2019 08:25:53 +0000 https://petaminds.com/?p=1048 TensorFlow 2.0 is out! Get hands-on practice at TF World, Oct 28-31. TensorFlow Ads Since the TF2.0 API reference lists have already been made publicly available, TF2.0 is still in RC.2 version. It is expected that the final release will be made available in the next few days (or weeks). What’s new in TF2.0: The […]

The post New TensorFlow 2.0 vs 1.X – Quick note appeared first on Petamind.

]]> https://petaminds.com/new-tensorflow-2-0-vs-1-x-quick-note/feed/ 0 AI in agriculture: fruit grading (Part 1) https://petaminds.com/use-ai-technology-in-agriculture-for-fruit-grading-part-1/ https://petaminds.com/use-ai-technology-in-agriculture-for-fruit-grading-part-1/#comments Thu, 26 Sep 2019 03:37:27 +0000 http://petaminds.com/?p=645 During a meet up last month, a friend told me about the current project on a farm in New Zealand. They want to build a system to grade their fruits and AI is the technology they are looking for. It inspired me to write about how machine learning can help in solving such a problem. […]

The post AI in agriculture: fruit grading (Part 1) appeared first on Petamind.

]]> https://petaminds.com/use-ai-technology-in-agriculture-for-fruit-grading-part-1/feed/ 1 ETL (Extract, Transform, and Load) Process Quick note https://petaminds.com/etl-extract-transform-and-load-process-quick-note/ https://petaminds.com/etl-extract-transform-and-load-process-quick-note/#respond Mon, 18 Feb 2019 07:55:00 +0000 https://petaminds.com/?p=1825 You could have been playing with this concept so many times without knowing the name of ETL. Let have a quick concept review using MovieLens automation as examples. Concept According to Wikipedia: Extract, Transform and Load (ETL) refers to a process in database usage and especially in data warehousing that: Extracts data from homogeneous or […]

The post ETL (Extract, Transform, and Load) Process Quick note appeared first on Petamind.

]]> https://petaminds.com/etl-extract-transform-and-load-process-quick-note/feed/ 0 Machine learning quick note https://petaminds.com/machine-learning-quick-note/ https://petaminds.com/machine-learning-quick-note/#comments Mon, 01 Oct 2018 09:43:19 +0000 http://petaminds.com/?p=355 Machine learning is a terminology to describe the uses statistical techniques to give computer systems the ability to “learn” (e.g., progressively improve performance on a specific task) from data, without being explicitly programmed. You can think of machine learning as the brains behind AI technologies, and AI technologies do the actions. More technically, machine learning is the […]

The post Machine learning quick note appeared first on Petamind.

]]> https://petaminds.com/machine-learning-quick-note/feed/ 1