The Entrepreneur Forum | Startups | Entrepreneurship | Starting a Business | Motivation | Success

EXECUTION Process thread: Subscription website

Remove ads while supporting the Unscripted philosophy...become an INSIDER.

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
6/16/2020
-Didn't have much time worked from 6AM to 10PM looked over some code.
 

Don't like ads? Remove them while supporting the forum. Subscribe.

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
6/18/2020
-wrote another spider for a different website to add to my data I think I need about 4 more to have enough sources for my minimum viable product
-I realized I was approaching it wrong doing one spider at a time, now I have every spider template made so when I have a problem on one I can ask a question on a forum and while I am waiting I can just work on a different spider considerably increasing my efficiency.
 

100k

Gold Contributor
Read Millionaire Fastlane
Speedway Pass
Oct 20, 2012
1,383
1,953
576
Good on ya.

Though it might have made more sense not to waste time programming and coding.

Just do the work manually and PROVE there's a demand for the product and service, prove people are willing to pay $50/month to get access to the scraped info.

And just scrape the info/data manually or with scrapebox and post it on your website.

Once you've proven there's a demand for it, then you could hire a programmer or do the programming yourself (If you're a coder).

Other than that, good on ya. Keep at it.
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
Good on ya.

Though it might have made more sense not to waste time programming and coding.

Just do the work manually and PROVE there's a demand for the product and service, prove people are willing to pay $50/month to get access to the scraped info.

And just scrape the info/data manually or with scrapebox and post it on your website.

Once you've proven there's a demand for it, then you could hire a programmer or do the programming yourself (If you're a coder).

Other than that, good on ya. Keep at it.
I am very positive people are willing to pay for it because they already do and at a rate a lot more than $50/month. Just not in my country. Up until recently, this method was not possible due to regulations in the U.S. I have a lot of people I know and acquaintances interested in the product. I don't want to give up what I am working on in online forums because I don't want to give anyone the chance to catch up.

I would be very skeptical if there was no historical data of this product but it's already been proven people are willing to pay for it. The data is very time-sensitive and therefore cannot be manually scraped and the websites the data comes from are quite complex and dynamic and I think it would be difficult to get around this without a custom-coded solution. Unfortunately, there really isn't a quick way to push the product out due to the coding involved to get to the minimum viable product. I don't have tens of thousands of dollars to hire programmers so I guess I have to do it myself but I am pretty confident it will pay off. If it doesn't my web scraping skills are improving so much and I already have other website ideas using scraped data that I know I will find success somewhere if I keep at it.
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
6/20/2020 and 6/21/2020
-Added another spider to scrape a website to add data to the database.
-At this point, I have 10/16 spiders made to scrape the websites I need for my minimum viable product.

Steps once I complete writing the spiders:
1. Finish the data cleaning pipeline which shouldn't take long
2. Design front end of the website
3. Find a proxy service to implement so my spiders never get IP blocked
4. Upload spiders to scraping hub
5. A free trial run with potential customers to fix any bugs before releasing the product to the public
6. Open the website to the public and test different advertising/SEO methods
7.Collect $$$
 
Last edited:

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
6/30/2020 and 7/1/2020
-Was able to finish every other spider but one. Some of the websites share the same API making scraping super easy.
-Once I finish this last spider I am going to go through and confirm the functionality of each spider before moving on to cleaning all the data which should be pretty easy.
 

dario

New Contributor
Nov 14, 2012
26
11
18
I think I understood what's your product. Let's just say that it'll guarantee to your subscribers a small profit everyday.
Of course I'm not disclosing it to anyone to protect your business. BUT
I really would limit the number of subscribers and also raise the price.
The reason is that as soon as you add customers, the profit they get becomes smaller and smaller.
(Also you raise the risk to acquire a member who just resell the profitable data.)
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
I think I understood what's your product. Let's just say that it'll guarantee to your subscribers a small profit everyday.
Of course I'm not disclosing it to anyone to protect your business. BUT
I really would limit the number of subscribers and also raise the price.
The reason is that as soon as you add customers, the profit they get becomes smaller and smaller.
(Also you raise the risk to acquire a member who just resell the profitable data.)
Perhaps. I wouldn't say the profits get smaller with more people but it is possible somewhat. If my ultimate goal is a large sellout wouldn't the lower subscriber business model limit my ultimate goal?
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
On an unrelated note found out my company hired someone for the position I was to be promoted into in a couple of months. There is already someone in that position that is objectively completely incompetent but has a really impressive academic resume and seniority so they manage to hold on somehow, over me taking that position. I thought I was at a cool company that actually cared about my proven abilities but whatever. I am going to focus even harder on making this work. Sick of just working to make other people rich.
 

Don't like ads? Remove them while supporting the forum. Subscribe.

dario

New Contributor
Nov 14, 2012
26
11
18
Perhaps. I wouldn't say the profits get smaller with more people but it is possible somewhat. If my ultimate goal is a large sellout wouldn't the lower subscriber business model limit my ultimate goal?
You can make it a long lasting business if your customers are happy
But If the members, using the info you provide, have all the same behavior they probably get banned very soon
I would round the data you provide them. Or even randomize a little for each member.
The ROI for them is slightly lower, but they aren't using all the same exact value. And don t lose their accounts.
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
You can make it a long lasting business if your customers are happy
But If the members, using the info you provide, have all the same behavior they probably get banned very soon
I would round the data you provide them. Or even randomize a little for each member.
The ROI for them is slightly lower, but they aren't using all the same exact value. And don t lose their accounts.
That's actually really smart thanks for the suggestion man.
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
7/3/2020 and 7/4/2020
-Technically all of my spiders work now I am just doing some TLC on anything I went skimpy on to ensure each one works the same way as the next.
-I created guidelines that I want each spider I created and future spiders to follow so each is outputting the same data in the same format
-Reorganized Asana so now I have a clear vision of tasks I need to do. If I am trying to get an answer on a forum before I can complete one task I can just go to another in the meantime so I am not wasting any time.
- I figure by the end of the week I will have all spiders in perfect shape so I can start importing them into scraping hub and find a proxy service. Once this is done the coding side is pretty much finished I just need to design the website.
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
7/5/2020
-Cleaned up all spiders and made sure they all follow the standards I made. Waiting on a single StackOverflow answer to fix one thing and then all my spiders are ready to go. Which is really exciting I am finally finished with that.
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
7/6/2020 and 7/7/2020
-Successfully deployed spiders on scrapinghub.
-Creating another script to compare all of the items and upload them to SQL database
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
What I did up to now:
-Spiders are straightened out and I found a proxy service and implemented other measures for preventing my spiders from getting banned
-Going to work on cleaning up the data now then I should be good to go from a data standpoint, then on to the website
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
-What appears to be a trivial problem matching up similar data from different websites is actually quite complex. For example, it is hard for a computer to understand that AAPL is referring to Apple if you can't pre-generate lists that tell it that AAPL is Apple. I am working with different libraries but it is a difficult problem to solve. I have been working on it for the past few days.
 

dario

New Contributor
Nov 14, 2012
26
11
18
-What appears to be a trivial problem matching up similar data from different websites is actually quite complex. For example, it is hard for a computer to understand that AAPL is referring to Apple if you can't pre-generate lists that tell it that AAPL is Apple. I am working with different libraries but it is a difficult problem to solve. I have been working on it for the past few days.

Did you already search on programmableweb.com for (existing but unofficial/undisclosed APIs) for the websites you're querying? Maybe you can find out at least one identifier for the many items you're comparing which is common across the platforms?
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
Did you already search on programmableweb.com for (existing but unofficial/undisclosed APIs) for the websites you're querying? Maybe you can find out at least one identifier for the many items you're comparing which is common across the platforms?
I just checked it out and they are not in there but I pretty much figured out the APIs using Chrome Dev tools by myself so I am good there. A couple of the websites share the same API but most do not and those are the comparisons I am talking about. But thanks for the suggestion!
 

Don't like ads? Remove them while supporting the forum. Subscribe.

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
Hey, any update? How go things?
I am still alive!

Here is what I have done since:
My code and spiders are workingly flawlessly.

-Completed all code.
-I implemented cloud logging throughout the code to quickly debug any errors as the script runs.
-I uploaded my code on an automated service and now it runs twice a day, I use the logs to debug any errors so now my code gets better and more robust almost every day.

What I am doing now:
-Finish designing the website.
-Let my friends do a trial run for free to get feedback.

Things I likely need to do more research on:
-Marketing. I truly beleive I have a solid product it's just getting the word out there! I actively use MJ's advice in one of his books now where he says something like"The best book is the one that solves the problem right in front of you. " I used to read a bunch of pointless self help books now I just read the ones that solve my immediate problems. It looks like I need a good digital marketing one.
 

Johnny boy

Platinum Contributor
Speedway Pass
May 9, 2017
783
3,743
867
24
Washington State
If you have no sales you have no evidence this is a good idea since you are unwilling to pre-sell, create a minimum viable product, or run ads to something that isn't ready yet, or even get feedback on the site.

In a business sense, you are trying to walk 10 dogs without leashes, trying to dig sand with a butter knife, trying to type with your nose, or whatever analogy describes inefficient and likely futile actions.

You need to get sales. You need to get people to give a f*ck. You need attention. You need feedback from actual customers. You need subscribers.

Imagine you want to date some girl. Would you plan out your life together, plan out the first 15 dates, plan out every little detail and spend a year doing this all before you even go ask her out to see if she's interested? That's what you're doing right now. Instead, you should ask them out FIRST. Because if there is no interest, you're absolutely wasting your time.

Get some sales. Get some subscribers. Get some attention. Get an audience. Run some ads.

I'm starting a subscription website as well. Its my 2nd business. My primary business pays the bills.

Guess how I'm starting it?

A $50 theme, repurposed to fit my needs.

Buying a directory list of contacts for $79

Sending out an ad campaign to thousands of people.

IF it works, I'll pursue it. If nobody gives a f*ck and I realize it was not an idea that people cared about, I would scrap it.

You are going to be much too deep into this thing to turn back without having some serious emotional trauma since you're investing so much into something with 0 market validation.
 

Busch_Jager

Contributor
FASTLANE INSIDER
Jan 4, 2019
50
40
56
Pittsburgh, PA
If you have no sales you have no evidence this is a good idea since you are unwilling to pre-sell, create a minimum viable product, or run ads to something that isn't ready yet, or even get feedback on the site.

In a business sense, you are trying to walk 10 dogs without leashes, trying to dig sand with a butter knife, trying to type with your nose, or whatever analogy describes inefficient and likely futile actions.

You need to get sales. You need to get people to give a f*ck. You need attention. You need feedback from actual customers. You need subscribers.

Imagine you want to date some girl. Would you plan out your life together, plan out the first 15 dates, plan out every little detail and spend a year doing this all before you even go ask her out to see if she's interested? That's what you're doing right now. Instead, you should ask them out FIRST. Because if there is no interest, you're absolutely wasting your time.

Get some sales. Get some subscribers. Get some attention. Get an audience. Run some ads.

I'm starting a subscription website as well. Its my 2nd business. My primary business pays the bills.

Guess how I'm starting it?

A $50 theme, repurposed to fit my needs.

Buying a directory list of contacts for $79

Sending out an ad campaign to thousands of people.

IF it works, I'll pursue it. If nobody gives a f*ck and I realize it was not an idea that people cared about, I would scrap it.

You are going to be much too deep into this thing to turn back without having some serious emotional trauma since you're investing so much into something with 0 market validation.

Thanks for the advice.

While I do agree with what you are saying, the website I am creating is already a proven concept. It wasn't possible to create this website in the U.S. until recently due to regulation changes. I have confirmed interest in the related online forums as well as people I know that are interested in this space.

People with the money already pay coders to do this personally but their is no public means to access this information. If you don't have tens of thousands of dollars to have someone code this for you you are out of luck. I am making it accessible at a much lower price point. Without explaining the product I agree 100% it seems like I may be wasting my time.

If for some reason this was to tank (which I don't believe it will) I told myself I won't be too upset about it because I got 100x better at web scraping and thought of other business ideas I can apply this skill to.
 

Sponsored Offers

  • Sticky
FEATURED! Introducing... WEALTH EXPO$ED, A Short Story By MJ DeMarco
Hi Mj, I just bought it. And reading it. I think is a great idea to write using the stories to...
  • Sticky
MARKETPLACE Fox Web School "Legend" Group Coaching Program 2020
Great post @Fox, very much appreciated! How can I reach out to you? I sent you a PM a while...
  • Sticky
MARKETPLACE Lex DeVille's - Advanced Freelance Udemy Courses!
Hey @Lex DeVille ! Having some issues with the NOREGRETS code? Udemy thinks it has expired...
  • Sticky
MARKETPLACE Grow Your Business With a Book (An Unorthodox Marketing Strategy That Built One of the Largest...
Are you looking for a new, lesser-known but potentially very lucrative source of leads to your...
  • Sticky
MARKETPLACE You Are One Call Away From Living Your Dream Life - LightHouse’s Accountability Program ⚡
Just got off the phone with @LightHouse. Having just a 45 minute conversation with him has...
  • Sticky
MARKETPLACE Kill Bigger Incubator
@Kak Thanks for the reply. Whats interesting is that I have an idea that's been cooking which...



Forum Sponsor

sponsor

New Topics

Fastlane Insiders

View the forum AD FREE.
Private, unindexed content
Detailed process/execution threads
Monthly conference calls with doers
Ideas needing execution, more!

Join Fastlane Insiders.

Top Bottom