Menu
  • HOME
  • TAGS

What is the best and fast way to check data in string duplicate or not?

php,string,duplicates

Put those values into an array, remove duplicate values, and then compare that array to the original array. If they're the same there are no duplicates. $values = explode(',', $data); var_dump($values == array_unique($values)); Demo...

Ignore duplicate in string and print string once

java,string,if-statement,while-loop,duplicates

You can put all the string token in Set and check if that token contain in Set befor you process further as below :- // Declration .... Set courseSet = new HashSet(); ... // Check befor you process further if(!courseSet.contains(course)) { ... // Your Code... ... courseSet.add(course) } ...

trying to delete automatically added and sorted answers from a VBA textbox into excel cells

excel,vba,delete,duplicates,add

It is generally recommended to disable events inside event processing code if you are likely to trigger the event you are processing. Delete will cause the Selection to change which will cause this event to fire again. See this excellent post on the topic. To resolve, add Application.EnableEvents = False...

How do I avoid saving duplicate records when saving objects with many to many relationships?

c#,entity-framework,asp.net-mvc-5,duplicates,many-to-many

I'd say you are on the right track. If tag names are unique theres no need to "Count" though. Just get the first one if it exists. Swap out dupes and do nothing for uniques // check for duplicate entries foreach (var tag in post.Tags.ToList()) { var dupeTag = uwork.TagRepository.GetAll().FirstOrDefault(t...

C++ do…whille loop duplicate prints with getchar function

c++,loops,duplicates,do-while,getchar

A quick fix: do{ puts("Menu"); std::cin >> option; } while (option != '3');...

R — frequencies within a variable for repeating values

r,count,duplicates

You can try library(data.table)#v1.9.4+ setDT(yourdf)[, .N, by = A] ...

ms-access Group BY a match between several fields

sql,ms-access,duplicates,group

You can create a union query: SELECT Field1 AS FieldValue FROM MyTable UNION ALL SELECT Field2 AS FieldValue FROM MyTable UNION ALL SELECT Field3 AS FieldValue FROM MyTable Now use this query as source in a query similar to your original....

Remove almost duplicated strings

arrays,string,perl,duplicates

keeping the spirit of what you tried: my %seen; my @result = grep {! $seen{(split "_",$_)[0]}++} <DATA>; print @result; __DATA__ revised_1.4_1.4-1.05-jan revised_1.5_1.8-before revised_1.5_1.8-after revised_1.5_0.7-mid deleted&reviewed_0.9-0.8-1.05-jan deleted&reviewed_1.6_1.6-before deleted&reviewed_0.5_1.8-after deleted&uploaded_0.8_1.9-midweek deleted&uploaded_1.0_1.3-offweek accessedbeforesecondquarter_0.8._1.6-jan accessedbeforesecondquarter_0.9_1.7-feb result: revised_1.4_1.4-1.05-jan...

Conditionally removing duplicate rows from a data frame

r,data.frame,duplicates,conditional

Looks like a job for aggregate(). # Input data frame df <- data.frame(Gene=c("AKT", "MYC", "MYC", "RAS", "RAS", "RAS", "TP53"), Expression=c(3, 2, 6, 1, -4, -1, -3)) # Maximum absolute value of Expression by Gene maxabs <- with(df, aggregate(Expression, list(Gene=Gene), FUN=function(x) max(abs(x)))) # Combine with original data frame df <- merge(df,...

duplicate an android studio project

android,gradle,duplicates,project,sync

i think that i found the source of my problem it was a virtual machine problem. so the solution is : open file -> settings clic to : compiler in the VM option field put te following value: -Xmx512m That's all...

mysql duplicate rows and replace

mysql,replace,duplicates

You could use an insert-select statement. To just duplicate the rows: INSERT INTO mytable SELECT * FROM mytable WHERE <some condition> To duplicate with a different style: INSERT INTO mytable SELECT col1, col2, 'someString' AS style FROM mytable WHERE <some condition> ...

Find duplicate element in a list of lists [closed]

python,duplicates,nested-lists

Assuming you're looking for a specific target (your question was unclear): def find_dupe(lists, target): seen = set() for lst in lists: for item in lst: if item == target and item in seen: return True seen.add(item) DEMO: >>> find_dupe([[20, 21, 22], [17, 18, 19, 20], [10, 11, 12, 13]], 20)...

create and insert randomly duplicates

python,random,duplicates

Not sure if I understand what you are trying to do. You'll probably need a library for random selection: import random Now here is your input string: s = "AppleStrawberryBananaCitrusOrange" print s You can use random.randint to select a random position and extract a 4-character word: i = random.randint(0, len(s)...

Multiple duplicates (2 times, 3 times,…) in R

r,duplicates,duplicate-data

I would use ave to write a simple function like this: myFun <- function(vector, thresh) { ind <- ave(rep(1, length(vector)), vector, FUN = length) vector[ind > thresh + 1] ## added "+1" to match your terminology } Here it is applied to "v": myFun(v, 1) # [1] "c" "c" "c"...

Is there a better way to find duplicate rows _including_ the first/last?

python,pandas,duplicates

You can count occurrences of a and return values>1 for duplicated rows. In [25]: df[(df.groupby('a').transform('count')>1).values] Out[25]: a b 0 1 a 1 1 s 2 1 d ...

Find duplicates with a suffix in excel and keep results

excel,excel-formula,duplicates

do you mean the data you have looks like this: column A column B column C ABC 5 ABC-123 3 ABC-543 2 if so, you can select column A then go to data then text to columns then delimited select other by putting - sign, next and finish. result must...

How do unique indexes really work and avoid collisions?

mongodb,indexing,duplicates,unique-constraint

Writes can not be applied simultaneously to the dataset. When a write is sent to a MongoDB instance, be it a shard or a standalone server, here is what happens A collection wide write lock (which resides in RAM) is requested When the lock is granted, the resulting data to...

Excel to sum value of duplicates while retaining its duplicate text

excel,duplicates,value

One important point to consider here: First, because you need to sum values AND change the values you're summing, you're going to get a circular reference if you try to do this dynamically. One way to get around this is to add a third column, with the formula =SUMIF(A:A,A1,B:B) If...

VB Remove duplicate lines from textbox

vb.net,visual-studio,textbox,duplicates

You could use a HashSet(Of String) + String.Join: Dim uniqueUrls As New HashSet(Of String) For Each curElement As HtmlElement In theElementCollection If curElement.GetAttribute("href").Contains("/watch") Then uniqueUrls.Add(curElement.GetAttribute("href")) End If Next TextBox1.Text = String.Join(vbCrLf, uniqueUrls) ...

using ruby to delete duplicate words from text file

ruby,delete,duplicates,readfile

I would do it like this: require 'set' def copy_unique_lines(source, target) lines = Set.new File.open(target, 'w') do |out| File.open(source, 'r').each_line do |line| if lines.add?(line) out << line end end end end In which source and target are file paths: copy_unique_lines('path/input.txt', 'path/output.txt') ...

SQL Show All column by one column distinct

sql,oracle,select,duplicates,distinct

try this: SELECT * FROM myTable WHERE ID IN(SELECT MIN(ID) FROM myTable GROUP BY Code) ...

Finding all permutations of a number without duplicates (edited for clarity)

javascript,arrays,recursion,duplicates

This is how I would do it: var permute = (function () { return permute; function permute(list) { return list.length ? list.reduce(permutate, []) : [[]]; } function permutate(permutations, item, index, list) { return permutations.concat(permute( list.slice(0, index).concat( list.slice(index + 1))) .map(concat, [item])); } function concat(list) { return this.concat(list); } }()); function...

mysql self join with group_concat and without duplicates

mysql,duplicates,group-concat,self-join

This is a rather unorthodox solution, but hey... SELECT MIN(x.id) id , GROUP_CONCAT(DISTINCT y.id) duplicates FROM duplicates x JOIN duplicates y ON y.name = x.name AND y.id > x.id GROUP BY x.name ...

How to remove duplicates from a list of custom objects, by a property of the object [duplicate]

c#,linq,list,object,duplicates

var distinctItems = myList.GroupBy(x => x.prop1).Select(y => y.First()); ...

I want to give same number to the duplicate data in excel

excel,duplicates,serial-number

Sort your column A then insert the number 1 in cell B2 and the following function in cell B3 and copy down. in cell B2=1 function in cell B3: =if(A3=A2, B2, B2+1) Update ...

number of identical ids in a data frame [duplicate]

r,data.frame,duplicates

Try: library(dplyr) df %>% group_by(Group) %>% mutate(eventNumber = row_number()-1) ...

java.util.zip.ZipException: duplicate entry |Android Studio

android-studio,duplicates

compile 'com.android.support:support-v4:22.1.1' compile ('com.android.support:appcompat-v7:22.1.1') { exclude module: 'support-v4' } compile ('com.facebook.android:facebook-android-sdk:4.2.0') { exclude module: 'support-v4' } compile ('com.github.navasmdc:PhoneTutorial:[email protected]') { exclude module: 'support-v4' } ...

Regex/Algorithm to find 'n' repeated lines in a file

regex,algorithm,count,find,duplicates

One way is splitting your text based on your n then count the number of your elements that all is depending this counting you can use some data structures that use hash-table like dictionary in python that is much efficient for such tasks. The task is that you create a...

Remove duplicates numbers above 10 in a String [duplicate]

java,string,char,duplicates

Assuming that you are using a separator such as ,, you can use String.split() method which gives you an array of Strings and loop through all this strings, here's the code you need: String[] strArray = str.split(","); for(String string : strArray) { char [] charArray = string.toCharArray(); for (Character c...

Return value based on duplicate columns

mysql,sql,replace,duplicates

You can try with group by: select Firstname , Lastname , case when count(*) > 1 then '**ERROR**' else age end from Table group by Firstname , Lastname , age; Or in case you want to return all rows with duplicates: select t.Firstname , t.Lastname , case when (select count(*)...

Find a single duplicate in a list of lists Netlogo

list,duplicates,netlogo

This is quick and dirty, but find-dup should return the first duplicated item (in this case a sublist) in the list. to go let listA [[-9 2] [-9 1] [-9 0][-9 -1][-9 -2][-9 -3][-9 -4][-8 0][-9 0]] show find-dup listA end to-report find-dup [ c ] ;returns the first duplicated...

Python - Find same values in a list and group together a new list

python,list,duplicates,append

Someone mentions for N=[1, 2, 2, 3, 3, 3, 4, 4, 4, 4, 5, 5, 5, 5, 5, 1] it will get [[1], [2, 2], [3, 3, 3], [4, 4, 4, 4], [5, 5, 5, 5, 5], [1]] In other words, when numbers of the list isn't in order or...

Return duplicates in a list based on 2 criteria

r,list,duplicates,subset

We can use Reduce with intersect in base R lapply(my.list, function(x) x[with(x, Letters %in% Reduce(intersect, split(Letters, Numbers))),]) Or using dplyr library(dplyr) lapply(my.list, function(x) x %>% group_by(Letters) %>% filter(n_distinct(Numbers)==2)) Instead of having a list, it can be changed to a single dataset with an additional grouping column and then do the...

SQL - Select distinct on two column

sql,postgresql,sql-update,duplicates,distinct

When you use GROUP BY you cannot include in the select list a column which is not being ordered. So, in your query it's impossible to inlcude Id in the select list. So you need to do something a bit more complex: SELECT Id_Category, Id_Theme, (SELECT Id FROM Words W...

Collection without duplicates (based on id) but keeps the highest version number

java,collections,duplicates

You can wrap a map and provide additional methods, that check item version. Here is put method, for example. class MyMap<ID, E> extends HashMap<ID, E extends Versioned & HasId<ID>> { public void put(E elem) { if (containsKey(elem.getId()) { E exist = get(elem.getId()); if (elem.version.isGreater(exist.version)) super.put(elem.getId(), elem); } else { super.put(elem.getId(),...

How do I obtain the duplicated values of two ArrayLists?

java,arraylist,duplicates,array-merge

You can use the List#retainAll(Collection<?> c) method, which: Retains only the elements in this list that are contained in the specified collection (optional operation). In other words, removes from this list all of its elements that are not contained in the specified collection. List<Point> first = ... List<Point> second =...

how to reject duplicate values [closed]

python,duplicates,prompt

Store your numbers in a collection, such as a list. Then you can check if new numbers are already in the collection before adding more. integers = [] while len(integers) < 10: a = input("Enter an integer: ") if a in integers: print("Sorry, that number was already entered.") else: integers.append(a)...

R - remove “one after another” duplicates

r,duplicates,zoo

You can use the run length encoding lengths to pick out the rows you want. If used raw in a cumsum it will give you the last value in a sequence, but you can get the first by subtracting the lengths from the cumulative sum and adding one. x <-...

Removing duplicates from a data frame, very fast

r,duplicates

We could get the index of rows (.I[which.min(..)) that have minimum 'VALUE' for each 'SYMBOL' and use that column ('V1') to subset the dataset. library(data.table) dt[dt[,.I[which.min(VALUE)],by=list(SYMBOL)]$V1] Or as @DavidArenburg mentioned, using setkey would be more efficient (although I am not sure why you get error with the original data) setkey(dt,...

cannot invoke get int on the array type comparable[ ]

java,arraylist,duplicates,syntax-error

Arrays don't have the get(int) method. Instead, they use the [int] syntax: if (data[i].equals(data[j])) { return true; } ...

Create a new array adding duplicate values together

javascript,arrays,duplicates

This will work: var source = [['bourbon', 2], ['bourbon', 1],['scotch', 2]]; var hash = {}; var consolidated = []; source.forEach(function(item) { hash[item[0]] = (hash[item[0]] || 0) + item[1]; }); Object.keys(hash).forEach(function(key) { consolidated.push([key, hash[key]]); }); jsFiddle...

Find duplicate values in input

java,hashmap,duplicates,hashset

Give this a try... It utilizes a HashMap of Lists public static void main(String[] args) { List<String> inputs = new ArrayList<>(); inputs.add("Apple: 0 1"); inputs.add("Apple: 4 5"); inputs.add("Pear: 0 10"); inputs.add("Pear: 11 13"); inputs.add("Apple: 5 10"); inputs.add("Apple: 2 4"); Map<String, List<Fruit>> fruits = new HashMap<>(); for (String input : inputs)...

Check for duplicates in JSON

javascript,jquery,json,duplicates

var asset = [ { value1: "1", value2: "2", value3: "3" }, { value1: "1", value2: "5", value3: "7" }, { value1: "6", value2: "9", value3: "5" }, { value1: "6", value2: "9", value3: "5" } ]; function countEqual(oo, pp) { var count = 0; oo.forEach(function (el) { var i,...

Adobe After Effects: Keep “Expression-Relations” when duplicating multiple layers

duplicates,expression,adobe,after-effects

You might end up wanting to organize your comp differently, but, given your example (and exactly those name lengths), this position expression will work to find the appropriate 'target layer': //base name to work from: baseName = "Layer"; //length of that: nameLen = baseName.length; //this layer's name: myName = thisLayer.name;...

How to display empty values after duplication of form

javascript,duplicates

You need to empty the value of input on your clone like this $(document).ready(function() { var id = 1; // get item var item = $("#addparts"); var before = $('#div_button'); // initalize event click $('#addMore').on('click', function() { // clone addparts var clone = item.clone(true); // remove id clone.attr('id', ''); //...

Pull all records only if 3 dups or more exist

sql,duplicates

I think you want something like - gives you all rows with 3 or more records SELECT category, measure, date FROM my_table t1 inner join ( SELECT category, measure FROM my_table group by category, measure having count(*) >= 3 ) t2 on t2.category = t1.category and t2.measure = t1.measure To...

Python: Rename duplicates in list with progressive numbers without sorting list

python,list,duplicates,rename

This is how I would do it. mylist = ["name", "state", "name", "city", "name", "zip", "zip"] from collections import Counter # Counter counts the number of occurrences of each item counts = Counter(mylist) # so we have: {'name':3, 'state':1, 'city':1, 'zip':2} for s,num in counts.items(): if num > 1: #...

Oracle - Arbitrarily pick one of multiple rows based on single unique key

sql,oracle,group-by,duplicates,candidate-key

You can use min in analytical version here, it is fast: select TGroup, min(Group_Desc) over (partition by tgroup) from t SQLFiddle demo first_value is also the option: select TGroup, first_value(Group_Desc) over (partition by tgroup order by subgroup) gd from t ...

Returning a formatted string does not working properly

java,format,return,duplicates,string.format

If you store usernames using %03d, i.e. with leading zeros, you also should use this when you compare the string in your userNameList: userNameList.get(i).equals(String.format("%s%s%03d", p1, p2, p3)) ...

PHP / MySQL: How to return info if record already exists (without update)

php,mysql,ajax,insert,duplicates

You just need a simple SELECT call before inserting. $conn = new mysqli($servername, $username, $password, $dbname); $conn->set_charset("utf8"); if($conn->connect_error){ die("Connection failed: " . $conn->connect_error); } $email = $_POST["email"]; $dob = $_POST["dob"]; $sql = "SELECT email FROM Users WHERE email = " .$email; $query = $conn->query($sql); if (mysqli_num_rows($query) > 0){ echo "There...

highlight “partial” duplicates across entire sheet in Google Sheets using conditional formatting

formatting,duplicates,conditional,highlight,partial

Thanks to a genius over at the Google Product Support Forums named Isai Alvarado I finally have the solution... =if(C2<>"",ArrayFormula(countif(left($C$2:$Z$18,4),left(C2,4)))>1) I hope this helps anyone else trying to highlight partial duplicates across multiple columns. ...

std::find in a vector of glm::vec3 is not working (OpenGLTriangle Normals with a crease angle)

c++,opengl,vector,find,duplicates

You can't compare floating point values simply using a simple x == y expression as if they were integers. You have to compare them using a "threshold", a "tolerance", e.g. something like: // Assuming x and y are doubles if (fabs(x - y) < threshold) { // x and y...

removing and aggregating duplicates

r,duplicates,subset,lapply

You could do: library(dplyr) df %>% # create an hypothetical "customer.name" column mutate(customer.name = sample(LETTERS[1:10], size = n(), replace = TRUE)) %>% # group data by "Parcel.." group_by(Parcel..) %>% # apply sum() to the selected columns mutate_each(funs(sum(.)), one_of("X.11", "X.13", "X.15", "num_units")) %>% # likewise for mean() mutate_each(funs(mean(.)), one_of("Acres", "Ttl_sq_ft", "Mtr.Size"))...

Remove first occurrence of a number from a list

r,duplicates

You can use match and negative indexing. v[-match(x, v)] produces [1] "d09" "d01" "d02" "d13" match only returns the location of the first match of a value, which we use to our advantage here. Note that %in% and is.element are degenerate versions of match. Compare: match(x, v) # [1] 6...

sql find and remove duplicate columns with trim

mysql,sql,duplicates,trim

Use TRIM in the select and GROUP BY clauses: SELECT COUNT(*) AS nb_duplicates, our_ref, TRIM(BOTH '\n' FROM partner_ref), partner_tag FROM partners_entries GROUP BY our_ref, TRIM(BOTH '\n' FROM partner_ref), partner_tag HAVING COUNT(*) > 1 Use an extended TRIM syntax to remove the newlines and other symbols from your data SQL Fiddle...

R !Duplicate by Factor Level

r,data.frame,duplicates

library(dplyr) test%>%group_by(fact,id)%>%distinct(id) ...

Deleting duplicates in a time series

sql-server,duplicates,time-series,sql-delete

You can do this using a CTE and ROW_NUMBER: SQL Fiddle WITH CteGroup AS( SELECT *, grp = ROW_NUMBER() OVER(ORDER BY MS) - ROW_NUMBER() OVER(PARTITION BY Value ORDER BY MS) FROM YourTable ), CteFinal AS( SELECT *, RN_FIRST = ROW_NUMBER() OVER(PARTITION BY grp, Value ORDER BY MS), RN_LAST = ROW_NUMBER()...

Delete common objects in two vectors/get duplicate objects in a vector (NOT erase)

c++,vector,duplicates

Getting all the repeated elements of a vector is a costly operation (you would have to iterate for each vector element through all the rest of the vector) and won't be an "easy" way to do it (talking about iterations) but transforming into a set and back don't seem a...

Access SQL: How to find duplicate records between dates

sql,ms-access,duplicates

One method is to use exists: select t.* from table as t where date between #2014-01-01# and #2014-12-31# and exists (select 1 from table as t2 where date between #2014-01-01# and #2014-12-31# and t2.sn = t.sn and t2.date <> t.date ); However, this will not find an sn that has...

Handle side effects caused by duplicate POST requests

web-services,rest,post,duplicates,idempotent

This a common problem with concurrent users. One way to solve it is to enforce conditional requests, requiring clients to send the If-Unmodified-Since header with the Last-Modified value for the resource they are attempting to change. That guarantees nobody else changed it between the last time they checked and now....

How to check if exists any duplicate in Java 8 Streams?

java,duplicates,java-8

Your code would need to iterate over all elements. If you want to make sure that there are no duplicates simple method like public static <T> boolean containsUnique(List<T> list){ Set<T> set = new HashSet<>(); for (T t: list){ if (!set.add(t)) return false; } return true; } would be more efficient....

How to find matching rows in Pandas DataFrame with identical values with same/opposite signs in certain columns?

python,pandas,duplicates,dataframes,matching

This idea should work: Self join DF on c,d Apply condition of opposite values... A quick and dirty code ndf = merge(left=df1,right=df1,on=('c','d'),how='inner') out = ndf[(ndf.a_x == (-1)*ndf.a_y) & (ndf.b_x == (-1)*ndf.b_y)] Please let me know if this works...

How to filter based on duplicate values in one column and consecutive values in another using PLSQL?

plsql,count,duplicates

PL/SQL isn't strictly required to find data sharing one attribute but having consecutive values on another attribute. Using your general table structure, the following will locate any transaction pair sharing the same BIZ_DATE and AMT, with adjacent TRANS_IDs. After creating and loading the table: CREATE TABLE MY_TABLE ( BIZ_DATE DATE...

PHP multidimensional array, average of duplicate values

php,arrays,multidimensional-array,duplicates

What about adding a count field to your result array... foreach ($reviews as $val) { if (!isset($result[$val['sku']])) { $result[$val['sku']] = $val; $result[$val['sku']]["count"] = 1; } else{ $result[$val['sku']]['rating'] += $val['rating']; $result[$val['sku']]["count"] ++; } } foreach($result as $k => $v) { $result[$k]['avg'] = $v['rating']/$v['count']; } ...

ld: duplicate symbols for architecture x86_64

c++,osx,duplicates,x86-64,symbols

You have instantiated a Game instance in your header file "Game.h", and since this is being included in multiple files you end up with multiple instances of game at link time. Change: class Game { public: ... }game; to: class Game { public: ... }; extern Game game; and then...

PHP: Checking two arrays for duplicate values

php,arrays,duplicates

You have to make a third array that handles the resultant value i.e the full name. The following example will return two arrays, duplicates array and fullnames array without duplicates: <?php $firstname = array ( "John", "Tom", "Ben", "John", "David", "Julie", "David"); $lastname = array ("Kennedy", "Hyde", "Hughes", "Harper", "Walter",...

Appending charactes to a string when duplicate found

sql-server,sql-server-2012,duplicates

Try this one: SQL Fiddle WITH CteUpdate AS( SELECT *, base = REPLACE(Name, 'x', ''), xxName = REPLICATE('x', ROW_NUMBER() OVER( PARTITION BY REPLACE(Name, 'x', '') ORDER BY ID ) + 1 ) + REPLACE(Name, 'x', '') FROM TestData WHERE REPLACE(Name, 'x', '') IN( SELECT Name FROM TestData WHERE [Update] =...

Excel: Count of unique items while ignoring junk duplicates

excel,count,duplicates

Let say your column is column A with IDs from row A2-A26, on A28 try this formula: =SUMPRODUCT((A2:A26<>"")/COUNTIF(A2:A26,A2:A26&"")) It worked for my other project. It doesn't need to create another column or table. ...

Find Duplicates in SQL Server Table

sql-server-2008,duplicates

With row_number window function: with cte as(select *, row_number() over(partition by UserID, clockin, clockout order by RecordID ) as rn from TableName) delete from cte where rn > 1 ...

Error : duplicate files during packaging of APK

android,duplicates,apk

Include exclude 'lib/armeabi-v7a/libmp3lame.so' as well in the PackagingOption section. packagingOptions { exclude 'META-INF/DEPENDENCIES' exclude 'META-INF/LICENSE' exclude 'META-INF/LICENSE.txt' exclude 'META-INF/license.txt' exclude 'META-INF/NOTICE' exclude 'META-INF/NOTICE.txt' exclude 'META-INF/notice.txt' exclude 'META-INF/ASL2.0' exclude 'lib/armeabi-v7a/libmp3lame.so' } ...

Counting the number of pairs in a vector

r,count,duplicates,categories

ng <- length(V)/2 table(sapply(split(V,rep(1:ng,each=2)),paste0,collapse="&")) # -1&-1 -1&1 1&-1 1&1 # 1 1 1 1 Here is a better alternative that also uses split, following the pattern of @MartinMorgan's answer: table(split(V,1:2)) # 2 # 1 -1 1 # -1 1 1 # 1 1 1 ...

How to rename duplicate lines with awk?

awk,duplicates,rename

$ awk 'cnt[$0]++{$0=$0" variant "cnt[$0]-1} 1' file I am a test line She is beautiful need for speed Nice day today I am a test line variant 1 stack overflow is fun I am a test line variant 2 stack overflow is fun variant 1 I have more sentences I...

Removing duplicate rows after checking all columns

excel,vba,excel-vba,duplicates

To delete the duplicate you can just click the "Remove duplicate" button at Data Ribbon > Data Tools. Following is the demo: I have the data like this in the worksheet: I would like to have unique data at column A click the "Remove duplicate" button and following screen prompted...

why only adding last element arraylist on new arraylist [closed]

java,for-loop,arraylist,duplicates,element

The last element is not being added to HM, you're adding a reference to the same list to HM. Iteration 1: HM = ["a"] Iteration 2: HM = [["a", "b"], ["a","b"]] Iteration 3: HM = [["a", "b", "c"], ["a", "b", "c"], ["a", "b", "c"]] This is easily fix by instead...

SQL exclude duplicated pairs of columns from a two-column select

sql,select,duplicates,distinct,rows

Its a very subtle change (> vs your !=), but what you want to do is use a diagonal elimination approach, whereby you exclude any reviewer with a rid lower than the current one: SELECT DISTINCT re1.name, re2.name FROM reviewer re1 INNER JOIN rating ra1 ON re1.rid=ra1.rid CROSS JOIN reviewer...

Need to find duplicates from an array in c++, and then put them in another array

c++,arrays,input,duplicates,output

To give you a better understanding of how to solve this, i'll try to show you what is going on via an example. Lets say you have just entered the 6 numbers you request via cin, and your a[] variable now looks like this in memory: a[] = { 5,...

Diff an Array (without modifying original arrays)

javascript,arrays,duplicates

Your code currently only crawls through one array (let's call it A) and pushes in all the A values that don't exist in B. You never go the other way and push in the B values that don't exist in A. There's also no need to have different behavior based...

SQL Query Filter to locate DUPLICATES in a column based on Values in 2 other columns

sql-server,filter,duplicates

You can use LEAD, LAG window functions in order to locate records that have been split: SELECT Name, MIN(ArrivalDate) AS ArrivalDate, MAX(DepartureDate) AS DepartureDate FROM ( SELECT Name, ArrivalDate, DepartureDate, CASE WHEN ArrivalDate = LAG(DepartureDate) OVER (PARTITION BY Name ORDER BY ArrivalDate) OR DepartureDate = LEAD(ArrivalDate) OVER (PARTITION BY Name...

hide options in comboBox java swing

java,swing,duplicates,jcombobox

Create POJO which represents the basic properties of the Piece... public class Piece { private Image image; private String name; public Piece(String name, Image image) { this.image = image; this.name = name; } public Image getImage() { return image; } public String getName() { return name; } } Add these...

C++ duplicate symbols

c++,osx,cmake,duplicates

Explicit function template specialisations are subject to the One Definition Rule, just as regular functions are. Add inline to allow definitions in a header; or define them in a source file, with declarations in the header.

opening file error with duplicates

python,duplicates

In each iteration of your loop, when: if not(chain in line): contain+=line print(contain) since you concatenate each line in contain, when you print it, it will show you the first sentece, from the first iteration, then the first+second sentences in the second iteration, and so on. Hence the duplication. Replacing...

PHP - Compare a string to all in array and only echo once (unique)

php,arrays,duplicates

This should work for you: Just get your file into an array and then grab the paths out of each line. <?php $lines = file("test.txt", FILE_IGNORE_NEW_LINES | FILE_SKIP_EMPTY_LINES); $directorys = array_unique(array_map(function($v){ preg_match("/.*? : \[.*?\] \"(.*?)\"/", $v, $m); return $m[1]; }, $lines)); print_r($directorys); ?> output: Array ( [0] => home/club/member [1]...

Python duplicate a python-igraph

python,reference,duplicates,igraph

Assign statements do not copy objects in Python. You might want to use copy.deepcopy() function. More details about copy.shallow() and copy.deepcopy() can be found in this answer Also Graph objects have inherited copy method which make deep copies. Use this code copy1 = fullGraph.copy() copy2 = fullGraph.copy() ...

What happens with duplicates when inserting multiple rows?

sql,postgresql,exception,duplicates,upsert

The INSERT will just insert all rows and nothing special will happen, unless you have some kind of constraint disallowing duplicate / overlapping values (PRIMARY KEY, UNIQUE, CHECK or EXCLUDE constraint) - which you did not mention in your question. But that's what you are probably worried about. Assuming a...

Use tSQL to sequentially increment value based on other values

sql,sql-update,duplicates

You can use ROW_NUMBER() for this: ;WITH cte AS (SELECT *,ROW_NUMBER() OVER(PARTITION BY [First],[Last],[Title],[Grade] ORDER BY Replicate) AS UPD_Replicate FROM Table1 ) SELECT * FROM cte Demo: SQL Fiddle Or to UPDATE the field: ;WITH cte AS (SELECT *,ROW_NUMBER() OVER(PARTITION BY [First],[Last],[Title],[Grade] ORDER BY Replicate) AS UPD_Replicate FROM Table1 )...

Duplicates issue

duplicates,sas

Another option could be Proc SQL, no pre-sort needed: proc sql; create table want as select * from have group by a, b, c, d having count(*)>1; /*This is to tell SAS only to keep those dups*/ quit; ...

VBA for duplicate rows

excel-vba,duplicates

Try this code: . Option Explicit Public Sub showDuplicateRows() Const SHEET_NAME As String = "Sheet1" Const LAST_COL As Long = 3 ' <<<<<<<<<<<<<<<<<< Update last column Const FIRST_ROW As Long = 2 Const FIRST_COL As Long = 1 Const DUPE As String = "Duplicate" Const CASE_SENSITIVE As Byte = 1...

R create a column based on duplicate values of one column, and a second column

r,duplicates

You want an aggregation: aggregate(B~A, df, FUN=sum) ...

Excel three column duplication and averaging

excel,duplicates,average

Just use a pivot table: Select all the data (including headers) in columns Latitude, Longitude, and Data. Choose Insert > PivotTable. Drag Latitude and Longitude into the Row Labels section. Choose PivotTable Tools > Design > Report Layout > Show in Tabular Form and Repeat All Item Levels. Also choose...

Excel - Compare more than a column using VLOOKUP

excel,duplicates

This was something close to what you were looking forward to, by just using formula than a macro/script. Essentially done using a concatenate function and VLOOKUP. Step 1. concatenate value from your database and add it under Col A. Step 2. Use VLOOKUP as in the image and compare using...

Excel VBA code: Preventing duplicates in a column regardless the sensitive case of the entry

excel,vba,excel-vba,duplicates

To change case in VBA, you have LCase and UCase, which will respectively change all of your string into lower case or upper case. Here is your code with the change and got ride of the useless (and ressource-greedy) select at the end : Sub tarheel() LastRow = Range("A10000").End(xlUp).Row +...

Delete files with same md5sum in cshell

shell,duplicates,md5sum

I'll assume that your goal is to delete certain lines from your textual input, not actually to delete the files. Like this: awk '! seen[$1]++' This reads from standard input. If the input is in a file, you can do: awk '! seen[$1]++' inputfile.txt Or, if it's the output of...