I hate to say this again, but Quote Loader started failing for "Yahoo HD" on 10/1
On the first of the 4th quarter, the Yahoo History quotes started failing. They not only did not return the 10/1 data they reported it as an error. Switching them all to non-history Yahoo works, but means that I need to get updates every day.
This is just more of the cat and mouse with Yahoo that is trying not to allow automatic downloads without looking at adverts.
Comments are currently closed for this discussion. You can start a new one.
Keyboard shortcuts
Generic
? | Show this help |
---|---|
ESC | Blurs the current field |
Comment Form
r | Focus the comment reply box |
---|---|
^ + ↩ | Submit the comment |
You can use Command ⌘
instead of Control ^
on Mac
1 Posted by dwg on 02 Oct, 2024 02:45 AM
Mike is looking at a different approach to take with Yahoo.
The latest update was "more work needed"
2 Posted by derekkent23 on 02 Oct, 2024 08:21 AM
I am not support staff, just a user.
Hi sth
Yes Yahoo have changed things AGAIN.
Just tested a new Quote Loader build 321301 created by Mike and it working great.
Not signed by Moneydance Sean yet.
3 Posted by DrgnMastr on 02 Oct, 2024 12:23 PM
Ran into the same problem, this morning, and tested the 321301 build of QL. It worked great.
4 Posted by derekkent23 on 02 Oct, 2024 01:30 PM
I am not support staff, just a user.
Hi
Quote Loader 321300 with Sean to be signed.
Have Fun, Stay Save.
5 Posted by dtd on 02 Oct, 2024 04:58 PM
derek - 321300 or 321301 ?
6 Posted by derekkent23 on 02 Oct, 2024 05:22 PM
I am not support staff, just a user.
Hi
Quote Loader 321301 released and signed.
Have Fun, Stay Save.
7 Posted by sth on 02 Oct, 2024 05:43 PM
I should have thanked Mike for all his work on this extension. And Derek for his documentation. It has been amazingly successful in the face of Yahoo's restrictions. Thank you!
8 Posted by derekkent23 on 03 Oct, 2024 07:32 AM
I am not support staff, just a user.
Hi sth
It does seem like Yahoo likes playing games, but Mike has done great work in maintaining Yahoo HD as a source. FT HD which has been stable for years covers all my Funds and I only use Yahoo HD to get historical exchange rates.
Have fun, stay safe.
9 Posted by sth on 03 Oct, 2024 01:39 PM
@Derek, It has been great! And thanks to you for the documentation of the features. I use FT HD for almost all of my funds, but there are individual stocks and a couple of retirement annuities that I use Yahoo or Yahoo HD for since FT doesn't seem to cover them well.
-Scott
10 Posted by sth on 05 Oct, 2024 02:12 AM
One thing I notices is that for Yahoo HD it now shows up as mm/dd/yy++ even when there is only one day of updates. FT HD only shows the "++" when there are multiple days of updates.
11 Posted by derekkent23 on 05 Oct, 2024 07:55 AM
Well Spotted. Made Mike aware.
12 Posted by sth on 05 Oct, 2024 05:39 PM
Again QL is fantastic and certainly beats my shell script to download AlphaVantage prices. I throttled it to keep within the AlphaVantage download restrictions and ran it on a daily basis, but it needed editing every time my list of equities changed. QL has much better coverage of multiple sources and great UI.
-Scott
13 Posted by Mike Bray (Quot... on 23 Oct, 2024 08:17 AM
Hi Scott I have corrected the problem with YahooHD and currencies. If you look in https://github.com/mrbray99/moneydanceproduction/tree/main/downloads you will see a file called securityquoteload321401.mxt. Download it and rename it to securityquoteload.mxt. Go to manage extensions and add the new version from file and give it a try.
MIke
14 Posted by sth on 23 Oct, 2024 08:04 PM
Mike, I will try this out tonight. Thanks again for all your work on this and maintenance!
I noticed something odd last night. I used the current version of QL and it downloaded about 80% of my quotes. That was probably as many as were available at that time of day.
But then I asked a few hours later for the remaining quotes. And got a few more. BUT there were a couple of securities that had an update value but the date was the day before the quote that I had gotten on the first try.
Date Quote NewQuote New %chg New$change New Date
10/22 XXXX YYYY -0.1 -0.Z 10/21
The fact that it was picking up an older date from the same source on a second try seems odd. I will try to get a screenshot and see if this happens with the new version.
15 Posted by derekkent23 on 23 Oct, 2024 08:47 PM
I am not support staff, just a user.
Hi sth
I have done some testing on securityquoteload321401.mxt and found some issues. You will now find securityquoteload321402.mxt on Mike site, I suggest you focus on that for testing.
16 Posted by derekkent23 on 23 Oct, 2024 10:00 PM
I am not support staff, just a user.
Hi sth
On the subject of date consistency in the past I have seen Yahoo Historical Data table drop the latest set of data and then later reinstate it.. So it appear the data has gone back one day, then be corrected later. Quote Loader reads the data that is available at the time you run it. So if at the time of the first run the data is up to date but when you run it a second time it appears to go back one day its reflection the data on the Yahoo web site at the time of the run.
To confirm this you not only need to take a Screen Shot of the QL table but also the Yahoo historical Data web page.
During testing of Mike latest QL I found the same sort of issue with Yahoo historical exchange rates.
I was getting rates for the 18, 21 and 23 but not for the 22. Mike pointed me to the Yahoo web page and sure enough data for the 22 was missing. Later in the day the missing data for the 22 appeared.
So take a look to see if its at QL or Yahoo issue.
17 Posted by sth on 23 Oct, 2024 10:59 PM
Derek, I agree. I did some checking an it is due to Yahoo weirdness. Attached is the Yahoo history. Note that it has closing data up until 10/22 but then lists the current price as of close 10/17 !! Unfortunately FT-HD does not cover this equity.
I will grab the 321402 version and see how it goes.
18 Posted by derekkent23 on 24 Oct, 2024 06:27 AM
I am not support staff, just a user.
Hi sth
Out of interest what is the Ticker for the subject equity.
19 Posted by sth on 29 Oct, 2024 05:32 PM
Derek,
The ticker is ORAN, and ADR for Orange, SA.
So quote loader is doing its job and downloading the history from Yahoo. As above. It also sets the "current price" to the 10/17 value and not the latest price. Yahoo clearly is having issues and it confused.
However, this brings me to an issue with MD that I have brought up before and unfortunately Sean disagrees with me that this is a problem.
The current value of a security should always be the latest value in the history. It should not be an independent variable! If a price is mistakenly entered for some date in the future by a year typo in a transaction, then that should not lock in the current value until a year has passed. When MD looks internally for the price of a security it should return that price for the most recent date equal to or before the current date from the history not from some other data source.
As for QL, it could follow the same sort of algorithm? It seems that it is getting the current price and the date of the current price? If so, if there is history quotes that are more recent than the "current price" then that latest quote should be used rather than the Yahoo definition of current price. Here is the history for the equity.
I admit that this is an ADR but as an ADR it should be handled like any other equity.
20 Posted by derekkent23 on 29 Oct, 2024 07:02 PM
I am not support staff, just a user.
Hi sth
I agree, in the Currency/Security History window the Current Price should be the last Dated Price.
In Quote loader in the Parameters tab that’s why I ensure the UPDATE MONEYDANCE CURRENT PRICE box is ticked.
I have had the same discussion with Sean as you, but after a long conversation we had to agree to disagree.
As for Orange SA the Ticker used by Yahoo seems to be ORANY see screen shot. With the Parameters tab UPDATE MONEYDANCE CURRENT PRICE box ticked the Last Dated Price and Current Price are the same.
Have Fun, Stay Safe.
21 Posted by sth on 29 Oct, 2024 07:54 PM
I have that box ticked as well but QL uses the "current price" that yahoo lists and not the most recent historical price. ORANY shows a slightly different price than ORAN and is not the ADR that I own. (ORANY was not a listed security at the time I made the investment).
So QL is using the older price in the header (circled in RED) to set the current price and not the most recent historical price (circled in BLUE) even though the historical price is more recent than the "current price" on the display. (10/22 vs 10/17)
22 Posted by derekkent23 on 29 Oct, 2024 09:01 PM
I am not support staff, just a user.
Hi sth
Yes from your screen shot the Yahoo the Current Price is given as 11.15 at close October 17. I agree that does not make sense. It’s a Yahoo issue, nothing Quote Loader can do about it. I would say it’s not the opening price on the 10th but the closing price on the 17th as shown in the table, which is also 11.15. See screen shot.
If I compare the closing prices that Quote Loader retrieved for ORANY they are the same as the closing prices from your screen shot.
Have Fun Stay Safe.
23 Posted by sth on 29 Oct, 2024 09:53 PM
Well, QL knows that this "current price" is from 10/17 and it knows that it has prices more recent than that. So QL can do something by comparing the dates and taking the latter close info as "current".
However something weird is going on. I just went to Yahoo to compare quotes since I had noticed them being different in the past, but a few cents. So tried to bring up ORAN and ORANY to check. Seems ORAN has been delisted as a ticker symbol?
https://finbox.com/NYSE:ORAN/ shows it as delisted. Maybe that is the weird issue that was messing things up....
24 Posted by derekkent23 on 29 Oct, 2024 10:23 PM
I am not support staff, just a user.
Hi sth
I don’t think Quote Loader can be expected to look for errors in the Yahoo data. I think it reasonable that Quote Loader use the data it is presented with. But that’s a decision for Mike.
I guess the question is does Yahoo make many mistakes or is this the exception. I don’t use Yahoo for Securities prices, as my Securities are funds and supported by FT HD. FT seems very reliable. I only use Yahoo HD for exchange rates. So if Yahoo does get it wrong from time to time in my day to day use I would not see it.
Have Fun, Stay Safe.
25 Posted by sth on 29 Oct, 2024 10:29 PM
I agree, and it seems that my brokerage converted the ADR shares to normal listed shares with no notice to me of the change and update of the ticker. Probably happened on 10/17 and that is why the current data froze.
It was just a suggestion on how QL could handle conflicting data. Maybe this only happens very seldom and we should just ignore it.
(Trying to stay safe... Not successful, fell down a rockslide and banged myself up and now I am isolating with COVID. Alll symptoms mild (both scrapes and sickness) and well vaccinated)
26 Posted by derekkent23 on 29 Oct, 2024 10:41 PM
I am not support staff, just a user.
Hi sth
By the way in case you have not seen it Sean has signed and released Quote Loader 321402.
I hope you recover soon, so take things easy.
27 Posted by Mike Bray (Quot... on 30 Oct, 2024 08:58 AM
Maybe I should buy ChatGPT and make it learn the errors Yahoo makes.
On 29/10/2024 22:23, derekkent23 wrote:
28 Posted by sth on 30 Oct, 2024 02:25 PM
@Mike.... :-)
And then buy a different LLM and learn the errors ChatGPT makes?
29 Posted by diveboss164 on 30 Oct, 2024 03:49 PM
On Oct 30, 2024, at 10:25 AM, sth <[email blocked]> wrote:
// Please reply above this line
==================================================
From: sth
@Mike.... :-)
And then buy a different LLM and learn the errors ChatGPT makes?
On Wed, Oct 30 at 01:58 AM PDT, Mike Bray (Quote Loader Author) wrote:
Having trouble reading this? View this discussion online: I hate to say this again, but Quote Loader started failing for "Yahoo HD" on 10/1.
To unsubscribe and stop receiving emails from https://infinitekind.tenderapp.com, visit this page
30 Posted by sth on 30 Oct, 2024 05:47 PM
@diveboss, No, the problem I had was Yahoo being confusing during a ticker delisting and QL got confused on it. Nothing to do with Plaid. If you have an issue, please start a new thread to discuss it.
sth closed this discussion on 30 Oct, 2024 05:47 PM.