talksik/mediapipe
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,373 Commits 9 Branches 53 Tags
7db0c1944b856d842414e1a1dfdc106e83f2b982
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Jiuqiang TangandCopybara-Service 0c01187cf5 Internal change 
PiperOrigin-RevId: 548886447
 2023-07-17 21:57:24 -07:00
Jiuqiang TangandCopybara-Service 6c7aa8a0d6 Internal change 
PiperOrigin-RevId: 544563029
 2023-06-29 23:05:37 -07:00
Jiuqiang TangandCopybara-Service 98d493f37a Add MatrixData as a packet option for ConstantSidePacketCalculatorOptions. 
PiperOrigin-RevId: 542616847
 2023-06-22 11:28:07 -07:00
Jiuqiang TangandCopybara-Service 169bdf15b4 Make an option for adjusting the face alignment output image size, and add a "transformation_matrix" output stream of the face stylizer graph. 
PiperOrigin-RevId: 535319310
 2023-05-25 11:21:06 -07:00
Jiuqiang TangandCopybara-Service 7facc925ba Allow FaceStylizerGraph to miss base options. 
Fix the color issue when the graph is running on gpu and "face alignment only" mode.

PiperOrigin-RevId: 534912498
 2023-05-24 11:14:30 -07:00
Jiuqiang TangandCopybara-Service 05c565898a Add image_segmenter_metadata_schema and object_detector_metadata_schema python files to the mediapipe python wheels. 
PiperOrigin-RevId: 530674961
 2023-05-09 12:02:31 -07:00
Jiuqiang TangandCopybara-Service c6e3f08282 Expose FaceAligner and LanguageDetector to be public MediaPipe Tasks Python API. 
PiperOrigin-RevId: 529227382
 2023-05-03 16:38:49 -07:00
Jiuqiang TangandCopybara-Service bf11fb313e Expose PoseLandmarker as a public MediaPipe Tasks Python API. 
PiperOrigin-RevId: 528882303
 2023-05-02 14:04:01 -07:00
Jiuqiang TangandCopybara-Service 4d9812af43 Pose detector uses advanced_gpu_api for gpu inference to resolve unsupported gpu op issue. 
PiperOrigin-RevId: 528879218
 2023-05-02 13:52:26 -07:00
Jiuqiang TangandCopybara-Service 60055f6fee Add more comments and usage example of the face stylizer graph. 
PiperOrigin-RevId: 528823127
 2023-05-02 10:32:43 -07:00
Jiuqiang TangandCopybara-Service fca728d226 Set face alignment image width and hight to 256. 
PiperOrigin-RevId: 528583074
 2023-05-01 15:01:39 -07:00
Jiuqiang TangandCopybara-Service 162a999887 Check the output stream tag rather than the input stream tag in face stylizer graph. 
PiperOrigin-RevId: 528555024
 2023-05-01 13:14:32 -07:00
Jiuqiang TangandCopybara-Service b9a9da5de5 Ignore fetching face stylizer model when the graph doesn't output stylized face images. 
PiperOrigin-RevId: 528504312
 2023-05-01 10:18:41 -07:00
Jiuqiang TangandCopybara-Service c29e43dda0 Add the "FACE_ALIGNMENT" output stream to the face stylizer graph. 
PiperOrigin-RevId: 528345204
 2023-04-30 16:59:36 -07:00
Jiuqiang TangandCopybara-Service 7c70c62465 Fix typo and improve comments. 
PiperOrigin-RevId: 527580369
 2023-04-27 08:10:29 -07:00
Jiuqiang TangandCopybara-Service 3bc8276678 Remove "All Rights Reserved." in copyright headers. 
PiperOrigin-RevId: 526982992
 2023-04-25 09:06:29 -07:00
Jiuqiang TangandCopybara-Service a0eb1b696c Internal changes. 
PiperOrigin-RevId: 526759809
 2023-04-24 14:45:35 -07:00
Jiuqiang TangandCopybara-Service 6773188e26 Make FaceLandmarksConnections to be a public class. 
PiperOrigin-RevId: 526667505
 2023-04-24 09:34:14 -07:00
Jiuqiang TangandCopybara-Service e14a88052a Remove resizing and rotation from face stylizer's postprocessing step. 
The resizing and rotation logic is useful when the pipeline needs to paste the stylized face image back to the original image. To only output the stylized face image, resizing and rotation may result to strange outputs.

PiperOrigin-RevId: 524441372
 2023-04-14 19:37:52 -07:00
Jiuqiang TangandCopybara-Service 67ed42d9c6 Always link the "pose_landmarks_detector_graph" target. 
PiperOrigin-RevId: 524397174
 2023-04-14 15:14:20 -07:00
Jiuqiang TangandCopybara-Service 534da98ccb Internal changes 
PiperOrigin-RevId: 524334347
 2023-04-14 11:01:53 -07:00
Jiuqiang TangandCopybara-Service e6bb9e29c0 Internal change 
PiperOrigin-RevId: 524317439
 2023-04-14 10:01:01 -07:00
Jiuqiang TangandCopybara-Service 8cedb82df1 Expose face stylizer and interactive segmenter to be public mediapipe python API. 
PiperOrigin-RevId: 522654239
 2023-04-07 12:12:49 -07:00
Jiuqiang TangandCopybara-Service bca0a92c2e Add FaceToRectCalculator. 
PiperOrigin-RevId: 522595752
 2023-04-07 07:44:51 -07:00
jqtang 3c05df9c46 Merge pull request #4235 from priankakariatyml:ios-object-detection-containers 
PiperOrigin-RevId: 521553151
 2023-04-03 15:12:06 -07:00
Jiuqiang TangandCopybara-Service 7f9fd4f154 Add the minimum version number requirement to sounddevice in requirements.txt. 
PiperOrigin-RevId: 520998845
 2023-03-31 13:27:42 -07:00
Jiuqiang TangandCopybara-Service 508c72ddc9 Internal changes 
PiperOrigin-RevId: 520775988
 2023-03-30 16:45:34 -07:00
Jiuqiang TangandCopybara-Service 984073bf73 Fix the "'<>' with anonymous inner classes is not supported" error. 
PiperOrigin-RevId: 520705926
 2023-03-30 12:05:08 -07:00
Jiuqiang TangandCopybara-Service 1e77725a15 Add necessary java lite proto source code to mediapipe tasks aar for the face landmarker task. 
PiperOrigin-RevId: 520143851
 2023-03-28 15:01:50 -07:00
Jiuqiang TangandCopybara-Service bda2639376 Switch to use the isPresent() API since the isEmpty() is only available since java 11: https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Optional.html#isEmpty(). 
PiperOrigin-RevId: 520099308
 2023-03-28 12:20:55 -07:00
Jiuqiang TangandCopybara-Service d4ec485971 Add face landmarker and face geometry java lite proto source code into mediapipe tasks AAR. 
PiperOrigin-RevId: 520049667
 2023-03-28 09:29:45 -07:00
Jiuqiang TangandCopybara-Service 94db96fa5e Add MatrixDataProto.java to mediapipe aar. 
PiperOrigin-RevId: 519925872
 2023-03-27 22:22:17 -07:00
Jiuqiang TangandCopybara-Service c3b4fa5627 Expose face detector and face landmarker as public MediaPipe Tasks Python API. 
PiperOrigin-RevId: 519822084
 2023-03-27 14:03:21 -07:00
Jiuqiang TangandCopybara-Service 55b9bd9d5e Internal change 
PiperOrigin-RevId: 519224694
 2023-03-24 13:33:47 -07:00
Jiuqiang TangandCopybara-Service d6256362ec Internal change 
PiperOrigin-RevId: 519186057
 2023-03-24 10:56:50 -07:00
Jiuqiang TangandCopybara-Service 21e0ff3d4e Skip unnecessary cpu<->gpu conversion if the input and output are already on the same storage. 
PiperOrigin-RevId: 518573284
 2023-03-22 08:22:38 -07:00
Jiuqiang TangandCopybara-Service b71e1d14d3 Add missing dependency library targets to mediapipe_task_aar. 
PiperOrigin-RevId: 518384666
 2023-03-21 14:38:11 -07:00
Jiuqiang TangandCopybara-Service 384f77b5c3 Fix the proto src file names. 
PiperOrigin-RevId: 518332541
 2023-03-21 11:34:39 -07:00
Jiuqiang TangandCopybara-Service 5a924669b7 Temporarily disabling checking whether the executor is not set in a subgraph node. This is a workaround to allow the MediaPipe InferenceCalculator to have its own executor. 
PiperOrigin-RevId: 518117759
 2023-03-20 17:10:55 -07:00
Jiuqiang TangandCopybara-Service f06e4224b8 Allow ModelResourcesCalculator to use file_pointer_meta. 
PiperOrigin-RevId: 517742722
 2023-03-19 01:33:52 -07:00
Jiuqiang TangandCopybara-Service 6634d22161 Add LabelMapProto.java source code to MediaPipe AAR. 
PiperOrigin-RevId: 517563190
 2023-03-17 19:49:53 -07:00
Jiuqiang TangandCopybara-Service 6785bcc47d Add java_package and java_outer_classname to label_map.proto. 
PiperOrigin-RevId: 517563000
 2023-03-17 19:45:45 -07:00
Jiuqiang TangandCopybara-Service 065f1f38aa Fix the vision tasks aar build rule to solve the "cannot find symbol" error: 
```
mediapipe/tasks/java/com/google/mediapipe/tasks/vision/imagesegmenter/ImageSegmenter.java:28: error: cannot find symbol
import com.google.mediapipe.tasks.TensorsToSegmentationCalculatorOptionsProto;
```

PiperOrigin-RevId: 517542284
 2023-03-17 17:02:22 -07:00
Jiuqiang TangandCopybara-Service 0805d61bfe Add the source code TensorsToSegmentationCalculatorOptionsProto.java into tasks core's maven package. 
PiperOrigin-RevId: 517516701
 2023-03-17 15:01:33 -07:00
Jiuqiang TangandCopybara-Service cd2cc971bb Registering FaceGeometry proto. 
PiperOrigin-RevId: 516663848
 2023-03-14 16:28:48 -07:00
Jiuqiang TangandCopybara-Service fef8b9cb58 Registering FaceGeometry proto. 
PiperOrigin-RevId: 516597971
 2023-03-14 12:21:02 -07:00
Jiuqiang TangandCopybara-Service 57f106e0a7 Wait until the metal backend finishes its work in the TensorsToImageCalculator. 
PiperOrigin-RevId: 516360846
 2023-03-13 16:56:46 -07:00
Jiuqiang TangandCopybara-Service 1d2041b992 Internal change 
PiperOrigin-RevId: 516220827
 2023-03-13 08:43:21 -07:00
Jiuqiang TangandCopybara-Service 3e8fd58400 Make createAudioRecord a class method not a static method. 
PiperOrigin-RevId: 515740313
 2023-03-10 14:34:32 -08:00
Jiuqiang TangandCopybara-Service 5bd6a7082a Add requiredInputBufferSize as an input argument of createAudioRecord. 
PiperOrigin-RevId: 515374407
 2023-03-09 10:30:49 -08:00
Jiuqiang TangandCopybara-Service 253a5b477e Implement face stylizer graph and its C++ API. 
PiperOrigin-RevId: 515139282
 2023-03-08 14:18:08 -08:00
Jiuqiang TangandCopybara-Service ddc535e705 Add DftTensorFormat To TensorsToAudioCalculatorOptions. 
PiperOrigin-RevId: 515077766
 2023-03-08 10:38:40 -08:00
Jiuqiang TangandCopybara-Service dbd6d72696 Add GetInputImageTensorSpecs into BaseVisionTaskApi for tasks api users to get input image tensor specifications. 
PiperOrigin-RevId: 514650593
 2023-03-07 00:44:07 -08:00
Jiuqiang TangandCopybara-Service 77fcaa9597 Allow TensorsToAudioCalculator to add and overlay adjacent windows. 
PiperOrigin-RevId: 514483756
 2023-03-06 12:08:57 -08:00
Jiuqiang TangandCopybara-Service 172b360478 Remove unused variable 'input_num'. 
PiperOrigin-RevId: 513009671
 2023-02-28 12:37:03 -08:00
Jiuqiang TangandCopybara-Service 646ab8505a Small fixes to TensorsToImageCalculator. 
PiperOrigin-RevId: 512967357
 2023-02-28 10:11:42 -08:00
Jiuqiang TangandCopybara-Service aa61abe386 Implement TensorsToImageCalculator. 
PiperOrigin-RevId: 512687103
 2023-02-27 11:46:07 -08:00
Jiuqiang TangandCopybara-Service 8a0830ce7b Add "java_package" and "java_outer_classname" to ImageTransformationCalculatorOptions. 
PiperOrigin-RevId: 510720513
 2023-02-18 16:58:56 -08:00
Jiuqiang TangandCopybara-Service 01c6a8b49b Add volume_gain_db option into AudioToTensorCalculator. 
PiperOrigin-RevId: 507748012
 2023-02-07 05:14:42 -08:00
Jiuqiang TangandCopybara-Service f4b0cf1cff Internal change 
PiperOrigin-RevId: 507540898
 2023-02-06 11:48:51 -08:00
Jiuqiang TangandCopybara-Service 8e097ea9c3 Internal changes 
PiperOrigin-RevId: 507016761
 2023-02-03 16:07:42 -08:00
Jiuqiang TangandCopybara-Service 2c4dece023 Internal change 
PiperOrigin-RevId: 505723714
 2023-01-30 10:00:22 -08:00
Jiuqiang TangandCopybara-Service 0566e0e7ca Fix the output stream tag of the end loop calculator in the example code. 
PiperOrigin-RevId: 504708273
 2023-01-25 17:52:55 -08:00
Jiuqiang TangandCopybara-Service 29484702ce Add process_timestamp_bounds into RectToRenderScaleCalculatorOptions. 
PiperOrigin-RevId: 502877541
 2023-01-18 08:02:47 -08:00
Jiuqiang TangandCopybara-Service 7a4b450c50 Resolve the error "call to 'abs' is ambiguous". 
PiperOrigin-RevId: 502630518
 2023-01-17 10:53:14 -08:00
Jiuqiang TangandCopybara-Service 7974171c3d Merge classificationResultList() and classificationResult() to be classificationResults(), and similar for embeddingResults(). 
PiperOrigin-RevId: 502601043
 2023-01-17 09:06:49 -08:00
Jiuqiang TangandCopybara-Service 8156da3418 ClassificationAggregationCalculator should fill in the timestamp_ms field of the classification results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the classification result helps reducing the confusion.

PiperOrigin-RevId: 501657922
 2023-01-12 13:54:55 -08:00
Jiuqiang TangandCopybara-Service 5c74ed2ae5 EmbeddingAggregationCalculator should fill in the timestamp_ms field of the embedding results in the stream mode. 
Per user feedback, the consistency between the packet timestamp and the timestamp field of the embedding result helps reducing the confusion.

PiperOrigin-RevId: 501572379
 2023-01-12 08:30:07 -08:00
Jiuqiang TangandCopybara-Service 25abd122b3 Support AudioRecord in MediaPipe audio tasks in Java. 
PiperOrigin-RevId: 501019327
 2023-01-10 09:45:40 -08:00
Jiuqiang TangandCopybara-Service 6032604f94 Hide base task api classes for MediaPipe Tasks Python from API docs 
PiperOrigin-RevId: 501004802
 2023-01-10 08:43:51 -08:00
Jiuqiang TangandCopybara-Service c8b8d1fe6b Remove scripts for building MediaPipe Python 3.7 wheels. 
PiperOrigin-RevId: 496962729
 2022-12-21 11:12:27 -08:00
Jiuqiang TangandCopybara-Service 714a6e555b Enable creating mediapipe image c++ packet directly from an Android media image object when its format is RGBA_8888. 
PiperOrigin-RevId: 496923491
 2022-12-21 08:07:53 -08:00
Jiuqiang TangandCopybara-Service 151e447614 Internal changes 
PiperOrigin-RevId: 496793199
 2022-12-20 17:52:17 -08:00
Jiuqiang TangandCopybara-Service 9067804005 Fix the missing logging component issue of mediapipe tasks core. 
PiperOrigin-RevId: 496548340
 2022-12-19 19:41:11 -08:00
Jiuqiang TangandCopybara-Service 7ce4bb72d4 Replace numpy.float with the builtin float type as numpy removes its own float type in v1.24. 
PiperOrigin-RevId: 496412858
 2022-12-19 09:02:51 -08:00
Jiuqiang TangandCopybara-Service 6bf5648430 Fix the documentation of the constructor of Image and ImageFrame Python classes. 
PiperOrigin-RevId: 495739875
 2022-12-15 17:42:23 -08:00
Jiuqiang TangandCopybara-Service fd50b6aa2f Add a new python unit test to test creating mediapipe Image from cvmat. 
PiperOrigin-RevId: 495655719
 2022-12-15 11:54:51 -08:00
Jiuqiang TangandCopybara-Service 299aa03302 Internal change 
PiperOrigin-RevId: 495613573
 2022-12-15 09:24:31 -08:00
Jiuqiang TangandCopybara-Service 174f2869a3 Internal changes 
PiperOrigin-RevId: 495322170
 2022-12-14 08:33:45 -08:00
Jiuqiang TangandCopybara-Service 78597c5b37 Internal changes. 
PiperOrigin-RevId: 495038477
 2022-12-13 09:08:15 -08:00
Jiuqiang TangandCopybara-Service 453d67de92 Add MergeDetectionsToVectorCalculator. 
PiperOrigin-RevId: 494246359
 2022-12-09 13:12:57 -08:00
Jiuqiang TangandCopybara-Service 13f8fa5139 Retire the visibility group "//mediapipe/framework:mediapipe_internal" in the "mediapipe/calculators/tensor" dir. 
PiperOrigin-RevId: 493895834
 2022-12-08 08:03:47 -08:00
Jiuqiang TangandCopybara-Service ef1507ed5d Retire the visibility group "//mediapipe/framework:mediapipe_internal". 
PiperOrigin-RevId: 493713823
 2022-12-07 14:45:49 -08:00
Jiuqiang TangandCopybara-Service 955f090f9f Retire the visibility group "//mediapipe/framework:mediapipe_internal". 
PiperOrigin-RevId: 493687025
 2022-12-07 13:08:33 -08:00
Jiuqiang TangandCopybara-Service 3c0ddf16b4 Fix an incorrect model sanity check in the object detector graph. 
PiperOrigin-RevId: 493663592
 2022-12-07 11:38:54 -08:00
Jiuqiang TangandCopybara-Service 80c605459c Open up framework visibility. 
PiperOrigin-RevId: 493660013
 2022-12-07 11:26:16 -08:00
Jiuqiang TangandCopybara-Service 6deef1a5f1 Allow specifying tag_suffix in the templated CreateModelResources method. 
PiperOrigin-RevId: 493375701
 2022-12-06 12:10:06 -08:00
Jiuqiang TangandCopybara-Service c6e6f9e0b9 Fix aar breakage caused by missing "//mediapipe/tasks/cc/vision/image_segmenter/proto:segmenter_options_java_proto_lite". 
PiperOrigin-RevId: 493357585
 2022-12-06 11:08:01 -08:00
Jiuqiang TangandCopybara-Service fb0b96115f Open up mediapipe core calculators' visibility. 
PiperOrigin-RevId: 493314353
 2022-12-06 08:40:57 -08:00
Jiuqiang TangandCopybara-Service 1761cdcef4 Fix aar breakage caused by missing "//mediapipe/tasks/java/com/google/mediapipe/tasks/components/containers:normalized_landmark". 
PiperOrigin-RevId: 493204770
 2022-12-05 22:16:46 -08:00
Jiuqiang TangandCopybara-Service 1e76d47a71 Checks if a custom global resource provider is used as the first step of loading the model resources on all platforms. 
PiperOrigin-RevId: 493141519
 2022-12-05 16:20:20 -08:00
Jiuqiang TangandCopybara-Service ead41132a8 Load model file content from model file path with the help of GetResourceContents in browsers. 
This can handle the model files that are provided via a custom ResourceProviderFn.

PiperOrigin-RevId: 492308453
 2022-12-01 15:03:57 -08:00
Jiuqiang TangandCopybara-Service af990c3da1 Open up the visibility of "//mediapipe/java/com/google/mediapipe/framework/image:image". 
PiperOrigin-RevId: 492308109
 2022-12-01 15:00:25 -08:00
Jiuqiang TangandCopybara-Service 3ee37800e2 Depending on "inference_calculator_cpu" when the mediapipe tasks can only support cpu inference. 
PiperOrigin-RevId: 492205954
 2022-12-01 08:43:30 -08:00
Jiuqiang TangandCopybara-Service e7eee27c1c Remove the deleted library "mediapipe/tasks/java/com/google/mediapipe/tasks/components/processors:embedderoptions" from mediapipe_tasks_aar's android_library deps list. 
PiperOrigin-RevId: 492200061
 2022-12-01 08:17:12 -08:00
Jiuqiang TangandCopybara-Service 460aee7933 Make mediapipe_tasks_aar's android_library depend on "//third_party:androidx_annotation". 
PiperOrigin-RevId: 492092487
 2022-11-30 20:45:02 -08:00
Jiuqiang TangandCopybara-Service c8a413bb4e Open up mediapipe framework's visibility. 
PiperOrigin-RevId: 491672877
 2022-11-29 10:19:44 -08:00
Jiuqiang TangandCopybara-Service 1b594a0310 Return error status when any tflite input and output tensor doesn't have valid dimensionality information that is needed to allocate Gl/Metal buffer before calling ModifyGraphWithDelegate. 
PiperOrigin-RevId: 489539740
 2022-11-18 12:44:55 -08:00
Jiuqiang TangandCopybara-Service e046982a3c Internal change 
PiperOrigin-RevId: 489484898
 2022-11-18 08:47:09 -08:00
Jiuqiang TangandCopybara-Service a94564540b Bump up the dependency library pybind11's version to 2.10.1. 
PiperOrigin-RevId: 488718815
 2022-11-15 11:51:20 -08:00