Update: Quote Loader, Getting Security Prices

Mike Bray (Quote Loader Author)'s Avatar

Mike Bray (Quote Loader Author)

16 Apr, 2024 07:17 AM

As you may know the format of Yahoo web pages has changed. This has broken Quote Loader and Quote and Exchange Rates Updater for the Yahoo source. This is not a simple fix.

Quote Loader has been recommended as an alternative using the FT source. Often the ticker used on FT is different than that used on Yahoo so just changing the source may not work. To help you overcome this these steps might help.

  1. Set up Quote Loader with a source of FT against each security
  2. Click on Save Changes
  3. Click on Get Prices
  4. Once all prices have been returned (green) or shown in error (red). Check the successful prices to see if the new price makes sense. What can happen is that the ticker used on Yahoo could be used for a different security on FT, thus the price will be quite a bit different. Identify those securities which are wrong and add them to the list of failed securities.
  5. Use your browser to got to ft.com (https://markets.ft.com/data)
  6. For each security use the Search securities box (top right) to find the page for your security (eq. Apple Inc). Once you have found it ft.com will display the name of your security with the ticker used by ft.com (eg. aapl:nsq).
  7. Copy this ticker and paste it into Alt Ticker box against your security, make sure the Exch Mod box is empty by double clicking on the box and choosing the first entry 'Do not use an exchange'
  8. Once you have updated all failing securities click on Save Changes
  9. Click on Get Prices

That should solve your issues, if you still have issues make sure there are not any spaces or wrong characters in the Alt Ticker box.

Showing page 2 out of 3. View the first page

  1. 31 Posted by derekkent23 on 22 Apr, 2024 07:50 AM

    derekkent23's Avatar

    I am not support staff, just a user.
    Hi davidwoh

    DrgnMastr is correct.

    The beauty of the Alt Ticker field is that you can add an Alternative Ticker within the Quote Loader window. You don’t need to go near the Currency/Security History dialog and select Edit. In the Quote Loader window set the Source to FT and just type in the Alt Ticker. The Alt Ticker only appear when a FT source is selected, so is not used when the source is Yahoo.

    Have Fun, Stay Safe.

  2. 32 Posted by Gretchen Chiara... on 22 Apr, 2024 06:14 PM

    Gretchen Chiaramonte's Avatar

    Found commodities on the FT page. These correspond to the GC=F, SI=F, etc. items on the Yahoo page. Not sure whether these will change as the dates approach
    Gold: US@GCM242:CMX
    Copper: US@HGK242:CMX
    Palladium: US@PAM242:NYM
    Platinum: US@PLN242:NYM
    Silver: US@SIK242:CMX

  3. 33 Posted by derekkent23 on 22 Apr, 2024 06:46 PM

    derekkent23's Avatar

    I am not support staff, just a user.
    Hi Gretchen

    Good research.

    But I don’t want to divert Mike’s efforts away from geting Yahoo working again. The testing I am doing suggests he is making good progress.

    Have Fun, Stay Safe.

  4. 34 Posted by david_nedved on 23 Apr, 2024 02:08 PM

    david_nedved's Avatar

    Those work great, thank you Gretchen!

  5. 35 Posted by becker6146 on 23 Apr, 2024 02:43 PM

    becker6146's Avatar

    Thanks for the info! This got my broken stock symbols working again.

  6. 36 Posted by Terry on 24 Apr, 2024 07:08 AM

    Terry's Avatar

    I was getting prices for Crypto from Yahoo, is there any work around for that?

  7. 37 Posted by derekkent23 on 24 Apr, 2024 07:25 AM

    derekkent23's Avatar

    I am not support staff, just a user.
    Hi Terry

    Sorry not that I am aware of. FT does not support crypto in a way Quote Loader can retrieve.

    However testing on getting Yahoo back on Quote Loader with a new build is going well.

    Have Fun, Stay Safe.

  8. 38 Posted by Timppa on 25 Apr, 2024 03:58 PM

    Timppa's Avatar

    I'm probably late to this conversation, since there's soon to be a fix to QL, but for what it's worth, I could not get FT to work under any circumstance. Followed the alt security instructions, tried editing my securities, nada.

    What I did figure out, AlphaVantage changed their throttling threshold (again) to 25 queries / day with the free API key. I own about 40 securities, so I loaded up the original Quotes and Exchange Rates extension, checked off half of them on Saturday morning and pulled updates, then repeated on Sunday for the rest. It pulls price history, like Yahoo HD did (hopefully does again after QL is fixed), so a weekly update is sufficient for me.

    Might be a plausible workaround for others who own <50 securities while we wait for QL to be fixed. Even if FT had worked for me (sigh) it doesn't include price history and it would have been very tedious to find and enter the alt id for all of my securities.

  9. 39 Posted by derekkent23 on 25 Apr, 2024 04:29 PM

    derekkent23's Avatar

    I am not support staff, just a user.
    Hi Timppa

    Quote Loader is fixed and with Infinite Kind (Moneydance) waiting to be signed and loaded under Extensions – Manage Extensions.

    It to late now, but if you read though the discussion relating to Quote Loader and using FT instead of Yahoo you will see I was able to help user switch in 99% of securities were the user provided the info I needed to help. It true FT HD only provides historical prices for Funds not Stocks.

    Have Fun, Stay Safe.

  10. 40 Posted by carrbigdog on 27 Apr, 2024 04:51 AM

    carrbigdog's Avatar

    A GIANT Thanks to Mike Bray, derekkent23 and all of those who contributed to developing, testing and introducing/suggesting alternatives to resolve everything surrounding this issue. Just want you all to know that we humble users appreciate the efforts and diligence it takes to keep these functions working.

    DanC

  11. 41 Posted by dtd on 27 Apr, 2024 05:34 AM

    dtd's Avatar

    Moana song: "You're welcome!"

    Seriously, "us users" use these functions as well, and want them to work as much as you do... we just dive in to help.

  12. 42 Posted by dwg on 27 Apr, 2024 06:20 AM

    dwg's Avatar

    I would echo @dtd.

    We use Moneydance and get involved with the program itself and extensions because we can. Some of us have had experience in the industry, writing programs, managing software, providing support, doing testing, doing consulting etc. We also have tended to be fairly heavy users of financial software over a long period.

    I think we all want Moneydance and the extensions to provide the best possible solution it can be, hence more incentive to be involved with the software's development and ongoing support.

    For me it also keeps my hand in an industry that I spent many years working in before retirement.

  13. 43 Posted by gnuite on 27 Apr, 2024 09:16 PM

    gnuite's Avatar

    Thank you, Mike Bray et al!

    With v3209, I was able to get quotes for the first 92 tickers, but the remaining 70 all failed. So it looks like maybe there's some throttling involved. I'll try again tomorrow, but I don't know how to tell Quote Loader how to fetch just those failed 70 tickers (other than changing the Source drop box, which I'm not interested in doing for 92 rows).

  14. 44 Posted by dtd on 27 Apr, 2024 09:36 PM

    dtd's Avatar

    Yahoo HD is timing out for folks with many tickers. As you say, Yahoo may be throttling multiple accesses at a time. It's being looked into.

    You might try Yahoo as an alternative - if that also times out, Mike would like to know.

  15. 45 Posted by dtd on 27 Apr, 2024 09:39 PM

    dtd's Avatar

    I don't know how to change some of the ticker sources, but you can change all of them by right clicking on the source header.

  16. 46 Posted by dwg on 27 Apr, 2024 11:58 PM

    dwg's Avatar

    With individual tickers just click on it and you get a popup where you can change what is used.

  17. 47 Posted by seanmustica on 28 Apr, 2024 05:05 PM

    seanmustica's Avatar

    All, is there any downside to keeping source as FT? It seems to load all my stock and fund prices just fine (46 tickers).

  18. 48 Posted by derekkent23 on 28 Apr, 2024 05:14 PM

    derekkent23's Avatar

    I am not support staff, just a user.
    Hi seanmustica

    If the source FT gives you what you want, then there is no downside.

    Have Fun, Stay Safe.

  19. 49 Posted by gnuite on 28 Apr, 2024 05:36 PM

    gnuite's Avatar

    Yahoo HD is timing out for folks with many tickers. As you say, Yahoo may be throttling multiple accesses at a time. It's being looked into.

    You might try Yahoo as an alternative - if that also times out, Mike would like to know.

    No problems with Yahoo (not HD) - all 162 tickers loaded fine.

    Retrying with Yahoo HD this morning produced the exact same result: the first 92 tickers loaded fine; the remaining 70 did not. Retrying a second time today resulted in zero tickers loading. So it seems to be a quota with a refresh rate of no more than 24 hours, possibly IP-based.

    I wonder if changing the "Amount of Yahoo history to collect" parameter affects the number of tickers that I can load. I have it currently set to "1 month", but I'll try tomorrow with "3 months" and see if that reduces the number of fetchable tickers.

  20. 50 Posted by derekkent23 on 29 Apr, 2024 07:13 AM

    derekkent23's Avatar

    I am not support staff, just a user.
    Hi gnuite

    Its Mikes assertion that for Yahoo HD retrieving 1, 2 or 3 months of history does not affect the number of securities that can be handled before hitting a limit.
    Lets see if you test confirms.

    Have Fun, Stay Safe.

  21. 51 Posted by gnuite on 29 Apr, 2024 05:28 PM

    gnuite's Avatar

    Assertion confirmed. With 3 months of history, 92 successes and 70 failures.

  22. 52 Posted by derekkent23 on 29 Apr, 2024 09:03 PM

    derekkent23's Avatar

    I am not support staff, just a user.
    Hi gnuite

    Good to have that confirmed.

    Mike is working on a fix which will probably for users with a large number of securities mean it will take longer to retrieve prices in an effort not to upset the source, but hopefully will retrieve all prices.

    Have Fun, Stay Safe.

  23. 53 Posted by copyjane on 02 May, 2024 03:47 PM

    copyjane's Avatar

    Hi everyone
    I followed this information using FT (FT HD doesn't work) and got the appearance of it working again, however, it only listed them as of 27 March, 2024. The stocks I'm working with in this instance are on European exchanges. I've selected and saved the prices, which updated each to today's date – but there's no historical prices in between today and March 27 (the last time I synced it). What else do I need to do? I suppose I just have to come back and update every day (or at least sporadically) until some Historical Data fix comes in.

    I have a method of grabbing six months of CSV prices from Nordic OMX, cleaning it of wierdness (WHYYYYY do Europeans use the comma instead of a decimal? Their date format makes perfect sense, but THIS convention is BONKERS), sending it to spreadsheet to strip it of all but Date/High/Low/Close/Volume, and then export/import it into Money Dance for 2 stocks and 2 funds that were not listed. But I hate to have to do this for all 10 stocks, and it would be near-impossible for me to do it for my 63 North American stocks and ETFs (3 accounts, diff purposes).

  24. 54 Posted by derekkent23 on 02 May, 2024 04:52 PM

    derekkent23's Avatar

    I am not support staff, just a user.
    Hi copyjane

    FT retrieves current prices for Funds and Stocke but does not retrieve Historical Data. FT HD retrieves Historical Data for Funds but not stocks.

    When retrieving Historical data gaps are not filled in. prices retrieved starts the day after the last day recorded.

    This is all covered in the PDF including a work around to fill in gaps, see page 14 post 93 at
    https://infinitekind.tenderapp.com/discussions/investments/7595-quo...

    Download the PDF’s attached to post 93 and have a read.

    Yahoo has imposed restrictions that means if you have a large number of securities around 50 and above it will not retrieve them all. Use FT HD, FT and Yahoo were you can to reduce the load on Yahoo HD. Make sure the box Include Securities with no holdings is unticked on the parameter window.

    If you still have problems after following this advice post a screen shots of the Quote Loader Parameter and Security windows. The security Window after you click GET PRICE so I can see the results.

    Hope this helps

  25. 55 Posted by mdu on 04 May, 2024 11:25 PM

    mdu's Avatar

    I have 385 securities (brokerage I use buys individual stocks to mimic S&P 500). I only get a percentage of them due to Throttling so I do hope Mike et al. can come up with a solution.

    The stock updates save me so much time reconciling my monthly statements - and I don't use MD daily so the historical prices are key to making sure I have the price on the month close date.

    I'll keep my fingers crossed for a solution. Thank you for the amazing work you do to make MD an incredibly useful application!

  26. 56 Posted by dtd on 04 May, 2024 11:35 PM

    dtd's Avatar

    Mike is getting there. One note - it is appropriate, given 385 securities, to only check like once a week or so... a GET for 1 day is the same as 7 days or 30 days.

    Given this for a historical record, you don't need to check it more than once in a while.

  27. 57 Posted by Mike Bray (Quot... on 05 May, 2024 06:15 AM

    Mike Bray (Quote Loader Author)'s Avatar

    I'm afraid there is nothing I can do about the throttling. This is
    Yahoo who has introduced it. I have tried to circumvent it by delaying
    each get quote by 2 seconds, however, there is no guarantee that Yahoo
    might complain. I am waiting on TIK to verify my changes. You can try
    out an unverified version by:

    going to
    https://github.com/mrbray99/moneydanceproduction/tree/main/downloads
    downloading securityquoteload321007.mxt
    renaming it to securityquoteload.mxt
    Open MD and go to Extensions/Manage Extensions
    Click on the Add from file button and select the file you have
    downloaded and follow the instructions
    Restart MD

    You will get a red banner saying Quote Loader is not verified, ignore it.

    Give it a try and see what happens, it will take a long time (770 seconds).

    On 05/05/2024 00:25, mdu wrote:

  28. 58 Posted by gnuite on 05 May, 2024 05:04 PM

    gnuite's Avatar

    I tried the version with "Yahoo Throttling Active." It worked slightly better: the first 117 loaded fine and the remaining 45 failed, rather than 92 loaded and 70 failed.

    Mike: How about a workaround where you fetch prices in order of "most-recent ticker price date" (earliest to latest), rather than in order of ticker string? Then at least we could retry over multiple days and backfill all history eventually.

  29. 59 Posted by Mike Bray (Quot... on 06 May, 2024 08:23 AM

    Mike Bray (Quote Loader Author)'s Avatar

    Good idea, I will have a look though I am waiting on TIK to verify some
    changes. It might be a few weeks.
    Mike

  30. 60 Posted by mdu on 07 May, 2024 05:19 AM

    mdu's Avatar

    I'll give it a try tomorrow - but I agree with gnuite's comment about fetching earliest to latest. Avoids me toggling from Do not load to Yahoo HD.

Reply to this discussion

Internal reply

Formatting help / Preview (switch to plain text) No formatting (switch to Markdown)

Attaching KB article:

»

Attached Files

You can attach files up to 10MB

If you don't have an account yet, we need to confirm you're human and not a machine trying to post spam.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac

Recent Discussions

16 Jun, 2024 03:09 AM
16 Jun, 2024 01:06 AM
15 Jun, 2024 10:41 PM
15 Jun, 2024 10:39 PM
15 Jun, 2024 08:58 PM