Very strange problems with OFX imported dividend reinvestment transactions from Fidelity

[Thomas Baumgart]

On Sonntag, 1. September 2024 22:07:10 CEST Jack via KMyMoney-devel wrote:

> On 2024.09.01 06:47, Thomas Baumgart via KMyMoney-devel wrote:
> > On Samstag, 31. August 2024 21:22:23 CEST Jack Ostroff via  
> > KMyMoney-devel wrote:
> > 
> >> I've been having problems with consistency check for a long time,  
> >> but never bothered to track down the cause.  I'm trying to do that  
> >> now, and everything I see just confuses me more.  I do assume that  
> >> the initial issue is introduced with the ofx import from Fidelity,  
> >> but I also think KMM is doing something funny here.
> > >
> > > For one transaction, consistency check says:
> > >   * Split S0002 in transaction 'T000000000000000258' contains  
> > different
> > > signs for shares and value. Please fix manually
> > 
> > I assume you do all this with the current master version. Can you  
> > send me the details of an unaltered transaction (screenshot of the  
> > Transaction detail output) via PM and maybe the plain XML of it?
> 
> Yes, compiled a few days ago, although --version only shows me kmymoney  
> 5.1.80- which happens sometimens, although I've never figured out why.
> 
> Even better, I'm attaching a much smaller xml file which shows the  
> problem.  I created a new file, including checking (not actually used,)  
> invest, and broker accounts.  I then imported the following lines,  
> which I copied from the actual download csv from Fidelity:
> 
>     Run Date,Account,Action,Symbol,Description,Type,Quantity,Price  
> ($),Commission ($),Fees ($),Accrued Interest ($),Amount ($),Settlement  
> Date
>     05/31/2024,"Corporation" Z46095109," REINVESTMENT FIDELITY  
> GOVERNMENT CASH RESERVES (FDRXX) (Cash)", FDRXX," FIDELITY GOVERNMENT  
> CASH RESERVES",Cash,153.89,1,,,,-153.89,

That is where the problem starts: the sign between shares (153.89) and amount 
(-153.89) differs!

I made some changes to master (already pushed to Gitlab) which is now capable
of correcting this situation. The best would be to fix the CSV importer to
handle that, but I don't want to touch that right now.

So when you import the above into the testfile, you now end up with the
scenario in attached screenshot1.png. It shows a difference of 307.78 which
is "2 * 153.89".

Simply double click on the transaction and immediately save it solves the
problem by adjusting the sign of the amount (see attached screenshot2.png)

Simply loading your existing transactions into the editor and saving them
should correct those existing transactions.

Hope that helps.

Thomas


> At the bottom of this message is the section from csvimporterrc for  
> this invest import.
> 
> What I'm particularly interested in is
> 1) why does the consistency check show an error (correctly, it seems)  
> but the ledger does not show any indication of a problem
> 2) the ledger shows a negative value, but on editing the transaction,  
> all amounts show positive
> 3) editing the transaction and changing the sign of the interest has no  
> effect, but changing the sign of the shares shows shares and value as  
> positive, but does show an error icon for a missing assignment of twice  
> the value.
> 4) editing again and changing the sign of the shares then fixes the  
> problem.
> 
> If the attachment of the xml file doesn't get through to the list, I'll  
> send it to you directly.
> > 
> > > This is a dividend reinvestment transaction, and the ledger shows  
> > the
> > > shares $149.44, price $1.00, and value $-149.44 (all in US Dollars,  
> > no
> > > currency conversions involved.)  However, there is no error icon on
> > > that entry.  Showing the transaction details matches these numbers  
> > in
> > > the stock account, and all are positive in the interest/dividends
> > > category,  If I then edit the transaction, all values show positive.
> > > If I then click the enter button without changing anything, the
> > > transaction shows an error icon with a missing assignment of  
> > $298.88.
> > > At that point, transaction details shows the same for the stock
> > > account, but shares and value both negative in the category account.
> > > Editing the transaction again shows all numbers positive, but Enter
> > > does not change anything.  If I then edit and change the shares to
> > > negative, the ledger looks the same, but transaction details shows
> > > negative shares and values in both accounts.  Another edit to remove
> > > the minus sign on the number of shares clears the error in the  
> > ledger
> > > and the transaction is no longer listed in the consistency report.
> > >
> > > This all makes no sense to me, since my edits add then remove a  
> > minus
> > > sign on the number of shares, I would not expect any net change,  
> > but at
> > > the end, both shares and value show negative in the category in the
> > > transaction details, although in the category ledger, it does show  
> > as
> > > income, not expense.
> > >
> > > Just to make things worse, if I start by looking at one of these
> > > transaction (I have several) in the category ledger, the amount is
> > > shown in the Expense coulumn, which is clearly wrong.  Transaction
> > > details, as above, show positive shares and negative value in the  
> > stock
> > > account but both positive in the category.  Editing and saving with  
> > no
> > > changes seems similar to doing so in the investment account ledger,
> > > with the error icon showing the missing assignement of twice the  
> > value
> > > and transaction details showing positive shares and negative vlue in
> > > the stock account, and both items negative in the category.   
> > However,
> > > if I then  edit the transaction, it shows as a Buy, with no Security
> > > shown, and 0 for shares and price.
> > >
> > > Since I never seem to notice this until long after I actually  
> > download
> > > those transacations, and I don't save the download file (web connect
> > > download) I'll have to find time to download a small sample and see  
> > if
> > > I can reproduce the problem in a smaller test file.
> 
> [Invest-FidelityInvest]
> AmountCol=11
> AutoAccountName=false
> BuyParam=buy
> DateCol=0
> DateFormat=1
> DecimalSymbol=2
> Directory=~/home/finance
> DivXParam=dividend,DIVIDEND RECEIVED FIDELITY GOVERNMENT CASH RESERVES  
> (FDRXX) (Cash),DIVIDEND RECEIVED FIDELITY GOVERNMENT MONEY MARKET  
> (SPAXX) (Cash)
> DontAsk=0
> Encoding=106
> FeeCol=-1
> FeeIsPercentage=false
> FeeRate=
> FieldDelimiter=0
> IntIncParam=interest,income
> MemoCol=
> MinFee=
> NameCol=4
> PriceCol=7
> PriceFraction=2
> QuantityCol=6
> ReinvdivParam=reinvest,reinv,re-inv,REINVESTMENT FIDELITY GOVERNMENT  
> CASH RESERVES (FDRXX) (Cash),REINVESTMENT FIDELITY GOVERNMENT MONEY  
> MARKET (SPAXX) (Cash)
> SecurityName=
> SecuritySymbol=
> SellParam=sell,repurchase
> ShrsinParam=add,stock dividend,divd reinv,transfer in,re-registration  
> in,journal entry
> ShrsoutParam=remove
> StartLine=2
> SymbolCol=3
> TextDelimiter=0
> TrailerLines=7
> TypeCol=2
> 

-- 

Regards

Thomas Baumgart

-------------------------------------------------------------
The secret of happiness is low expectations!
-------------------------------------------------------------
-------------- next part --------------
A non-text attachment was scrubbed...
Name: screenshot1.png
Type: image/png
Size: 10719 bytes
Desc: not available
URL: <http://mail.kde.org/pipermail/kmymoney-devel/attachments/20240905/4d86ed3b/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: screenshot2.png
Type: image/png
Size: 5266 bytes
Desc: not available
URL: <http://mail.kde.org/pipermail/kmymoney-devel/attachments/20240905/4d86ed3b/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 868 bytes
Desc: This is a digitally signed message part.
URL: <http://mail.kde.org/pipermail/kmymoney-devel/attachments/20240905/4d86ed3b/attachment-0001.sig>