How to integrate google cloud with dropbox and jupyter notebook using tensorflow

So I opened up a google cloud account and have access to global and local (us east 1) resources (Compute Engine API , NVIDIA K80 GPUs) and connected it to my dropbox. Next, I followed this youtube video to try to connect it to my jupyter notebook. The code to be entered into the google cloud platform is as follows: sudo apt-get update sudo apt-get - -assume-yes upgrade sudo apt-get - -assume-yes install software-properties-common sudo apt-get install python-setuptools python-dev build-essentials …
Category: Data Science

Using large files in a OVHcloud AI notebook

I’m trying to train an artificial intelligence model on OVHCloud AI Notebooks with the Common Voice’s dataset from Mozilla. The problem is that this database has a 70 GB size. I have tried to download it on my computer, and then to export the database to the OVHCloud Object Storage so I can use it, but this is excessively long. Is it possible to download directly this file on the notebook ? (My file is a tar.gz file)
Category: Data Science

Offload Media Library to other domain on a different server

How is it possible to change the media storage of Wordpress to a subdomain on a different server. The main domain example.com running on a server pointing to IP 192.168.0.1 and I've created a subdomain subdomain.example.com running on a different server pointing to IP 192.168.1.1 which in return has 2 different home directory URL example.com /home/example subdomain.example.com /home/example2 I'm clarifying those points because upload_path and upload_url_path works great when the domain and subdomain runs on the same server however here …
Category: Web

PointCloud value prediction - regression

I have point clouds for 400 objects. I have also some other features of these objects. For example their weights. How I can now train model to predict the weight based on the shape(point cloud)? I have seen pointnet but is seems it is only for classification?
Category: Data Science

Dividing a dataset to parallelize machine learning training on the cloud

I'm very new to machine learning. I am doing a project for a subject called parallel and distributed computing, in which we have to speed up a heavy computation using parallelism or distributed computing. My idea was to have a dataset divided in equal parts, and for each subset to have a neural network to be trained on a separate machine in the cloud. Once the models are trained, they would be returned back to me and somehow combined into …
Category: Data Science

Migrating Wordpress Uploads To S3 Object Storage

I currently migrate my wordpress media to s3 bucket. Does any one know of a way to redirect all the existing image urls to the s3 bucket instead if we manually copy the files over? Could this be done with a htaccess in the uploads folder or config from wp-config? I've tried using the following config but it doesn't work define('UPLOADS', 'http://s3_url/wp_content/uploads'); Thanks before.
Category: Web

Do I need to read an entire database for a recommendation system?

Let's say I have a database with approx 100000 rows. I want to build a content-based recommendation system. Do I really need to read the entire database to calculate similarity? That would be very expensive to do it hosted on AWS, Azure, etc. Additionally, my data is always changing (new data being added, old removed), so I can't just use a constant file. Is there a more cost-effective way?
Category: Data Science

What are good subscription based cloud ML platforms?

I'm currently working on multiple projects with Deep Learning and Keras. I've been using Google Colab for the last couple of months and it's been fantastic but I feel like I need stronger GPUs (maybe multiple V100s) to train some of the models that I have. My question is, are there any subscription based (not pay-as-you go) ML platforms out there that are similar to Google Colab? I'm willing to pay money and wouldn't mind paying a good amount per …
Category: Data Science

Where and how to do large scale supervised machine learning?

I'm beginner in ML and I have a large dataset that has 15 features with 6M rows, so it becomes challenging to work on it locally. I can train one model locally but to perform hyper parameter tuning and cross validations with my macbook pro, it runs out of memory and lacks the processing speed and capacity. I tried spark but that gives poor results, so I would prefer python native ecosystem of pandas and sklearn. So I want to …
Category: Data Science

How to run WordPress across 2 VMs for high availability

Microsoft Azure requires that applications utilize two instances across multiple data centers in order to achieve their "high availability" SLA and ensure your sites don't go down for routine maintenance. They even tell you which pairs of data centers will never go for maintenance at the same time. That's all well and good but how would you do this easily in practice for an app like WordPress with a MySQL database on the same VM? I'm no stranger to load …
Category: Web

Archived Server for Reference - Unable to Navigate Passed Homepage

I recently moved to a cloud-hosted WordPress instance from an outdated on-prem server. As reference, the on-prem server is still available locally. However, I am unable to navigate to any of the individual blogs hosted on the server. I can make it to the homepage, but after that all other pages result in 404 pages when requested. This issue is occurring on a Windows workstation with a manually set hosts file which points the website/domain name to the on-prem server. …
Category: Web

How to download finished Wordpress project from Google Cloud?

I created a WP website with hosting on Google Cloud just like an IP address. I already have an old website, which I now want to delete and replace by this new one. I would like to ask you, how can I download this project from Cloud to my computer, so I can later upload it on the server of the old website? Thank you for any advice!
Category: Web

Ideas on handling large quantities of "waste" data

Hello and thank you for taking time out of your day to help me. I am currently working on developing a machine vision application for production monitoring. The application handles images, about 20,000 images everyday are being processed and I want to come up with an interesting way to handle all this information. Let me first explain what the processing of every images does. The application is being implemented on a production line, when an item passes infront of my …
Category: Data Science

I need some assistance opening a few videos in VLC on android automatically from my wordpress site

Im using a dropbox plugin for a few videos and want them to auto open in VLC on android. I just need to pre-pend the vlc:// protocol before the dropbox links. How can I accomplish this automatically for adding new videos in the future. I tried modifying htaccess file so far but it didn't help. I tried the below. Redirect http://wordpresssite.com/app/wp-admin/admin-ajax.php?action=outofthebox-download vlc://http://wordpressite.com/app/wp-admin/admin-ajax.php?action=outofthebox-download and this as well Redirect https://content.dropboxapi.com/apitl/ vlc://https://content.dropboxapi.com/apitl/ Neither worked. Can someone please help me? I would be very …
Category: Web

Migrate Dash App to separate Data Studio Reports

I would like to know how can I do this and if it is makes sense to you. I have a Dash app written in Python in which: 1) I make the connection to my Databases (Python). 2) Perform several queries in SQL to obtain the data I need (Python). 3) If need, manipulate the query response with Python to obtain the desired metric (Python). 4) Build the plots (Python, Plotly, Dash) This Dash App is on a server and …
Category: Data Science

Securing WordPress running on Azure platform

We have a static website hosted on Microsoft Azure. Our marketing team wanted a easy way to update it so WordPress was installed on Azure, the site was created, marketing team updates it. A WordPress plug-in exports their updates as HTML which is shown on the static website. By not allowing WordPress to constantly run, it reduces our risk of WordPress vulnerabilities. Can using plug-ins like WordFence, iThemes security help for a case like this? How can I ensure when …
Category: Web

Can I install Tensorflow and Keras on Cloud?

I will like to install Tensorflow and Keras on my PC. I use 32 bits OS. I learnt Tensorflow is not compatible with 32 bits. I cannot upgrade my OS to 64 bits since my hardware does not support it. I have learnt one or two things about cloud computing but I only know about how I can use it for storage purposes. My question is, can I install Tensorflow and keras on cloud and somehow use them on my …
Category: Data Science

Sorting Tag Cloud by Popularity

So I have the default Wordpress Tag Cloud Widget on my sidebar/footer and I found the following code to limit the number that it's showing because it took up a ton of space. This code however is not actually showing the most popular tags, and I don't know what is causing this. function set_widget_tag_cloud_args($args) { $my_args = array( 'orderby' => 'count', 'order' => 'DESC', 'number' => 15 ); $args = wp_parse_args( $args, $my_args ); return $args; } add_filter('widget_tag_cloud_args','set_widget_tag_cloud_args'); So it …
Category: Web

About

Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.