Lead duplicate check check not loading leads properly

[ykhan]

I just uploaded a list and set the following:

Code: Select all

List ID Overdie: 1111
Phone Code Override: 1
File Layout to use: Custom Layout
Lead Duplicate Check: Check for duplicates by phone in List ID

LIST LOADER-     VERSION: 2.0.4     BUILD: 70510-1518

Once uploaded the system gives me the following output:

Code: Select all

Done GOOD: 3190       BAD: 1828       TOTAL: 5018

When I go back to the list page the number of NEW leads is just 123. I thought they would be 3190. When I went through the process again, I still got a similar output to the above with a variance of about +-100. WHat am I doing wrong here?

[mflorell]

Check the vicidial_list table to see how many have been inserted and see if there was a problem with what list they were going into. There is an insertion date on every lead in that table.

[ykhan]

I used the following query to check as you said:

SELECT list_id,status,entry_date,modify_date FROM `vicidial_list` WHERE list_id=1111 and status='NEW';
+---------+--------+---------------------+---------------------+
| list_id | status | entry_date | modify_date |
+---------+--------+---------------------+---------------------+
| 1111 | NEW | 2008-08-28 04:08:41 | 2009-01-20 13:03:42 |
| 1111 | NEW | 2009-01-21 11:32:42 | 0000-00-00 00:00:00 |
| 1111 | NEW | 2009-01-21 11:32:42 | 0000-00-00 00:00:00 |
| 1111 | NEW | 2009-01-21 11:32:42 | 0000-00-00 00:00:00 |
| 1111 | NEW | 2009-01-21 11:32:42 | 0000-00-00 00:00:00 |
| 1111 | NEW | 2009-01-21 11:32:42 | 0000-00-00 00:00:00 |

There were a total of 124 records, 123 newly added and one old one. I can't tell if there is a problem with this list. Am I missing something?

[mflorell]

try the query without the list_id part, but you might want to put an entry_date range in though.

[ykhan]

I'm not sure what exactly I should be looking for. When I did the process again, I noticed that the gender field had too many characters in the file so I omitted that field. Then the loader ran and gave me all duplicates. I think this time it ran ok cause of all duplicates.

Thanks Matt.

[mflorell]

Try taking a look at the MySQL statements file that is written to the vicidial web directory to see what it actually being sent to the database server for the inserts

[vccsdotca]

I am also experiencing this issue. List loader says 250 GOOD but the actual list states 128. I will continue to troubleshoot and will post an answer if I figure it out.

Matt
vccs.ca

[vccsdotca]

Ok. I this is output from the third upload attempt. I used duplicate checking on the last 2 attempts by Phone# in list. Good=107 which are the leads not previously imported out of 250, but when checking the list there is still only 140. You can see by record number that it is skipping randomly. It was enitially missing 30-39, 100-111, 150-152, 230-238 but did not actually import them.

record 10 BAD- PHONE: 2173754244 ROW: |1| DUP: 1
record 11 BAD- PHONE: 5053424660 ROW: |1| DUP: 1
record 12 BAD- PHONE: 3175467005 ROW: |1| DUP: 1
record 13 BAD- PHONE: 4192073232 ROW: |1| DUP: 1
record 14 BAD- PHONE: 8168428842 ROW: |1| DUP: 1
record 15 BAD- PHONE: 6035950550 ROW: |1| DUP: 1
record 16 BAD- PHONE: 6318788900 ROW: |1| DUP: 1
record 17 BAD- PHONE: 2094658413 ROW: |1| DUP: 1
record 18 BAD- PHONE: 3053611300 ROW: |1| DUP: 1
record 19 BAD- PHONE: 8303038600 ROW: |1| DUP: 1
record 20 BAD- PHONE: 2143528481 ROW: |1| DUP: 1
record 21 BAD- PHONE: 7134375200 ROW: |1| DUP: 1
record 22 BAD- PHONE: 8018877110 ROW: |1| DUP: 1
record 23 BAD- PHONE: 2768895612 ROW: |1| DUP: 1
record 24 BAD- PHONE: 2766760700 ROW: |1| DUP: 1
record 25 BAD- PHONE: 7575180550 ROW: |1| DUP: 1
record 26 BAD- PHONE: 7575950541 ROW: |1| DUP: 1
record 27 BAD- PHONE: 8047510010 ROW: |1| DUP: 1
record 28 BAD- PHONE: 7038232225 ROW: |1| DUP: 1
record 29 BAD- PHONE: 3605373229 ROW: |1| DUP: 1
record 40 BAD- PHONE: 2023282000 ROW: |1| DUP: 1
record 41 BAD- PHONE: 5094678210 ROW: |1| DUP: 1
record 42 BAD- PHONE: 8012663271 ROW: |1| DUP: 1
record 43 BAD- PHONE: 8107322470 ROW: |1| DUP: 1
record 44 BAD- PHONE: 7572531703 ROW: |1| DUP: 1
record 45 BAD- PHONE: 8606832222 ROW: |1| DUP: 1
record 46 BAD- PHONE: 8703563312 ROW: |1| DUP: 1
record 47 BAD- PHONE: 6207922128 ROW: |1| DUP: 1
record 48 BAD- PHONE: 3032145000 ROW: |1| DUP: 1
record 49 BAD- PHONE: 2125758811 ROW: |1| DUP: 1
record 69 BAD- PHONE: 5598342614 ROW: |1| DUP: 1
record 70 BAD- PHONE: 6087354645 ROW: |1| DUP: 1
record 71 BAD- PHONE: 5598342614 ROW: |1| DUP: 1
record 72 BAD- PHONE: 8089347673 ROW: |1| DUP: 1
record 73 BAD- PHONE: 7248347300 ROW: |1| DUP: 1
record 74 BAD- PHONE: 9087719300 ROW: |1| DUP: 1
record 75 BAD- PHONE: 7654362496 ROW: |1| DUP: 1
record 76 BAD- PHONE: 5302221412 ROW: |1| DUP: 1
record 77 BAD- PHONE: 7062786884 ROW: |1| DUP: 1
record 78 BAD- PHONE: 4046346396 ROW: |1| DUP: 1
record 79 BAD- PHONE: 7324691442 ROW: |1| DUP: 1
record 80 BAD- PHONE: 5035708689 ROW: |1| DUP: 1
record 81 BAD- PHONE: 5132408656 ROW: |1| DUP: 1
record 82 BAD- PHONE: 3017916880 ROW: |1| DUP: 1
record 83 BAD- PHONE: 5043927865 ROW: |1| DUP: 1
record 84 BAD- PHONE: 9727682909 ROW: |1| DUP: 1
record 85 BAD- PHONE: 8037168900 ROW: |1| DUP: 1
record 86 BAD- PHONE: 4809941616 ROW: |1| DUP: 1
record 87 BAD- PHONE: 5106598099 ROW: |1| DUP: 1
record 88 BAD- PHONE: 5023240988 ROW: |1| DUP: 1
record 89 BAD- PHONE: 8032526976 ROW: |1| DUP: 1
record 90 BAD- PHONE: 9072464710 ROW: |1| DUP: 1
record 91 BAD- PHONE: 9288716734 ROW: |1| DUP: 1
record 92 BAD- PHONE: 6264434208 ROW: |1| DUP: 1
record 93 BAD- PHONE: 7145259909 ROW: |1| DUP: 1
record 94 BAD- PHONE: 6512276457 ROW: |1| DUP: 1
record 95 BAD- PHONE: 9735890128 ROW: |1| DUP: 1
record 96 BAD- PHONE: 5012215000 ROW: |1| DUP: 1
record 97 BAD- PHONE: 4108768448 ROW: |1| DUP: 1
record 98 BAD- PHONE: 9513601908 ROW: |1| DUP: 1
record 99 BAD- PHONE: 5053568541 ROW: |1| DUP: 1
record 112 BAD- PHONE: 8454574678 ROW: |0| DUP: 1
record 120 BAD- PHONE: 2627847100 ROW: |1| DUP: 1
record 121 BAD- PHONE: 3102038770 ROW: |1| DUP: 1
record 122 BAD- PHONE: 4787881688 ROW: |1| DUP: 1
record 123 BAD- PHONE: 6108681322 ROW: |1| DUP: 1
record 124 BAD- PHONE: 2033743701 ROW: |1| DUP: 1
record 125 BAD- PHONE: 2315924960 ROW: |1| DUP: 1
record 126 BAD- PHONE: 4432850499 ROW: |1| DUP: 1
record 127 BAD- PHONE: 5012177400 ROW: |1| DUP: 1
record 128 BAD- PHONE: 6623321222 ROW: |1| DUP: 1
record 129 BAD- PHONE: 2018961700 ROW: |1| DUP: 1
record 140 BAD- PHONE: 2068824822 ROW: |1| DUP: 1
record 141 BAD- PHONE: 9184376881 ROW: |1| DUP: 1
record 142 BAD- PHONE: 9494995581 ROW: |1| DUP: 1
record 143 BAD- PHONE: 3639389282 ROW: |1| DUP: 1
record 144 BAD- PHONE: 4787850550 ROW: |1| DUP: 1
record 145 BAD- PHONE: 3027384880 ROW: |1| DUP: 1
record 146 BAD- PHONE: 6053043004 ROW: |1| DUP: 1
record 147 BAD- PHONE: 9896529906 ROW: |1| DUP: 1
record 148 BAD- PHONE: 9567269122 ROW: |1| DUP: 1
record 149 BAD- PHONE: 6182715500 ROW: |1| DUP: 1
record 152 BAD- PHONE: 7153656832 ROW: |1| DUP: 1
record 153 BAD- PHONE: 4142644550 ROW: |1| DUP: 1
record 154 BAD- PHONE: 6082760102 ROW: |1| DUP: 1
record 155 BAD- PHONE: 6088254884 ROW: |1| DUP: 1
record 156 BAD- PHONE: 7153872511 ROW: |1| DUP: 1
record 157 BAD- PHONE: 9209294000 ROW: |1| DUP: 1
record 158 BAD- PHONE: 3037333467 ROW: |1| DUP: 1
record 159 BAD- PHONE: 3045269111 ROW: |1| DUP: 1
record 160 BAD- PHONE: 3048223541 ROW: |1| DUP: 1
record 161 BAD- PHONE: 3076821445 ROW: |1| DUP: 1
record 170 BAD- PHONE: 6514643410 ROW: |1| DUP: 1
record 171 BAD- PHONE: 7603766019 ROW: |1| DUP: 1
record 172 BAD- PHONE: 4325718000 ROW: |1| DUP: 1
record 173 BAD- PHONE: 5104892000 ROW: |1| DUP: 1
record 174 BAD- PHONE: 8562169905 ROW: |1| DUP: 1
record 175 BAD- PHONE: 5409422250 ROW: |1| DUP: 1
record 176 BAD- PHONE: 5183259100 ROW: |1| DUP: 1
record 177 BAD- PHONE: 8464468003 ROW: |1| DUP: 1
record 178 BAD- PHONE: 9163312345 ROW: |1| DUP: 1
record 179 BAD- PHONE: 9549894700 ROW: |1| DUP: 1
record 180 BAD- PHONE: 5406630433 ROW: |1| DUP: 1
record 181 BAD- PHONE: 8175975000 ROW: |1| DUP: 1
record 182 BAD- PHONE: 9213615100 ROW: |1| DUP: 1
record 183 BAD- PHONE: 5095358078 ROW: |1| DUP: 1
record 184 BAD- PHONE: 6068862623 ROW: |1| DUP: 1
record 185 BAD- PHONE: 7704663123 ROW: |1| DUP: 1
record 186 BAD- PHONE: 5165420100 ROW: |1| DUP: 1
record 187 BAD- PHONE: 4803962381 ROW: |1| DUP: 1
record 188 BAD- PHONE: 2564637433 ROW: |1| DUP: 1
record 189 BAD- PHONE: 7049323383 ROW: |1| DUP: 1
record 200 BAD- PHONE: 7032600780 ROW: |1| DUP: 1
record 201 BAD- PHONE: 3098228575 ROW: |1| DUP: 1
record 202 BAD- PHONE: 2563864777 ROW: |1| DUP: 1
record 203 BAD- PHONE: 2083366000 ROW: |1| DUP: 1
record 204 BAD- PHONE: 9284532286 ROW: |1| DUP: 1
record 205 BAD- PHONE: 2706592548 ROW: |1| DUP: 1
record 206 BAD- PHONE: 9787259080 ROW: |1| DUP: 1
record 207 BAD- PHONE: 9013986388 ROW: |1| DUP: 1
record 208 BAD- PHONE: 9366377897 ROW: |1| DUP: 1
record 209 BAD- PHONE: 6618727262 ROW: |1| DUP: 1
record 220 BAD- PHONE: 8152352310 ROW: |1| DUP: 1
record 221 BAD- PHONE: 8504747288 ROW: |1| DUP: 1
record 222 BAD- PHONE: 9107556444 ROW: |1| DUP: 1
record 223 BAD- PHONE: 8479914646 ROW: |1| DUP: 1
record 224 BAD- PHONE: 8168426914 ROW: |1| DUP: 1
record 225 BAD- PHONE: 4199332441 ROW: |1| DUP: 1
record 226 BAD- PHONE: 8478061410 ROW: |1| DUP: 1
record 227 BAD- PHONE: 3077893864 ROW: |1| DUP: 1
record 228 BAD- PHONE: 2095480318 ROW: |1| DUP: 1
record 229 BAD- PHONE: 9134410420 ROW: |1| DUP: 1
record 239 BAD- PHONE: 3027384880 ROW: |1| DUP: 1
record 240 BAD- PHONE: 4197844010 ROW: |1| DUP: 1
record 241 BAD- PHONE: 5059821904 ROW: |1| DUP: 1
record 242 BAD- PHONE: 2626396770 ROW: |1| DUP: 1
record 243 BAD- PHONE: 6109625800 ROW: |1| DUP: 1
record 244 BAD- PHONE: 2488524153 ROW: |1| DUP: 1
record 245 BAD- PHONE: 8032831188 ROW: |1| DUP: 1
record 246 BAD- PHONE: 2146961732 ROW: |1| DUP: 1
record 247 BAD- PHONE: 7187357200 ROW: |1| DUP: 1
record 248 BAD- PHONE: 8045207775 ROW: |1| DUP: 1
record 249 BAD- PHONE: 8606781882 ROW: |1| DUP: 1

Done GOOD: 107 BAD: 143 TOTAL: 250

still 140 total
-------------------------
Now, these missing records had no different values from the others. Also, converting this file to "TAB Delimited" imported all leads as it should, resulting in 250 loaded.

[mflorell]

what was the original format of the file?

[ykhan]

Check to see if all the fields that you are uploading are the same size and data type as the schema of the table vicidial_list. I had issue cause of the GENDER field had MALE/FEMALE instead of M/F.

[vccsdotca]

Thanks.

The orig file was a CSV...

As for checking the field values. I went over some of the missing columns and there was nothing different about them. Ill check back into it soon and revert back if I have a solutions.




Matt
vccs

[mflorell]

I have seen non-alphanumeric cause problems before, anything like '"#$%^&*()@! can sometimes cause problems, although with tab-delimited it doesn't seem to as much.